Questions tagged [etl]

ETL stands for Extract, Transform, Load. It refers to a process of data-migration or data-integration.

Filter by
Sorted by
Tagged with
0
votes
0answers
27 views

Question regaring Oracle Data Integrator and salesforce

We are getting einstein analytics soon and we have oracle data integrator available (version 12.2.1). You can only get ODI in our company by request only so I will be telling them i need ODI do ETL. ...
1
vote
0answers
22 views

Can Jitterbit (or any ETL tool) do field-by-field “insert null values” without using the bulk API?

I can see that when an ETL tool is using the Bulk API, there isn't a global "insert null values" setting and you have to explicitly set cells to #N/A to get them to overwrite to null. That's nice, ...
5
votes
2answers
66 views

Transformation Spec limitation in Bulk API v1.0

We're using Transformation Spec feature of the bulk api when uploading records: https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/asynch_api_mapping.htm This allows us to ...
0
votes
1answer
48 views

Managing FTPs for multiple business units

I've run into an issue with the amount of licenses I have available to use in out ETL generator (Dell Boomi). Using this to push data into a 5 different business units and file dropping to the ...
2
votes
1answer
1k views

Change Data Capture vs Platform Events vs Replication API vs Streaming API vs Batch Data Synchronization [closed]

I have a requirement to sync Salesforce data from 2 objects to Datawarehouse and insert/update data from Datawarehouse to Salesforce.We want this data sync to be realtime for this application.Data ...
0
votes
0answers
33 views

Examining A Data Load's Tentative Results Without Really Loading Data

Let's say I have a "Contact" object full of 50,000 records, 30,000 of which have a value in "MyExternalId__c." And then I have a CSV file full of 10,000 records, all of which have a value in "...
1
vote
1answer
86 views

Help Combining SOQL Queries in ETL Tool

I'm using a SOQL query in an ETL tool to extract Account data from Salesforce and ultimately map it to our ERP system. The business has come up with two different use cases for extracting data in the ...
0
votes
1answer
50 views

Cannot see chatter feed when a field is updated by ETL

I have enabled tracking on some fields of product table, and would like to receive a chatter feed when I follow a record and there is a change in those fields. If I change manually the data I ...
1
vote
0answers
63 views

Import Users in Salesforce Error when User licenses limit exceeded

With Talend Open Studio for Data Integration, the tSalesforceOutputBulkExec component is used to import users in Salesforce. I tested the import of 1000 new users whith only 30 user licences ...
0
votes
2answers
50 views

Unexpected Error Parsing Query using Like Clause

I am attempting to test a query being used in an external application with salesforce integration where this query was generating a 'malformed query' error but I am running into an issue where the ...
0
votes
2answers
230 views

Command Line Apex Data Loader

any one worked on command Line apex data loader in windows system, I got an error, when I am checking the Verify encrypted command. C:\Program files\salesforce.com\data loader\bin>Encrypt.bat –v I ...
1
vote
0answers
24 views

Can an “SFDC changed data capture” by an ETL tool be made 100% reliable? [duplicate]

We've implemented an ETL extraction out of SFDC using the "Change data capture" mechanism with SFDC as the Data Master (described here). We do daily delta extractions using a filter on systemmodstamp ...
1
vote
2answers
3k views

what is the best ETL tool or approach to use to perform against a large data set from SFDC?

I have to perform some ETL process against SFDC data (opps, activities, leads, etc) where the SFDC data needs to be mapped to an excel mapping file and an output csv or txt file needs to be created. ...
1
vote
0answers
28 views

How to check used Module or Object name for the Salesforce report?

I have a report which is about Quotes in Salesforce created by one of the user, now I am trying to pull that report data using one of ETL tool talend using SOAP API's. But the issue is report are not ...
2
votes
1answer
183 views

Salesforce to Salesforce ETL - Automatic Data Transfers

My team is working on migrating to a new Org, from our previous Org. However, we need to use both and have the same data in both, as we will be rolling out clients in batches into the new Org, before ...
0
votes
1answer
173 views

Loading files to Documents : Standard object

Loaded some external files in to the sandbox using dataloader. Specified the path of the file in the Body column. The documents got loaded successfully. I have tried the same from one datastage job. ...
1
vote
1answer
99 views

User Lock Out (Python/Beatbox)

I'm currently implementing a solution using python to bring in information via the Beatbox module for python. http://tomhayden3.com/2013/08/04/salesforce-python/ I got it to write successfully to a ...
6
votes
3answers
938 views

Is ETL/script the best way to create SQL database from SF?

At our organization we would like to set up a SQL copy of our Salesforce instance for two reasons: 1) the app we are using in Salesforce is shutting down (Common Ground) and we we want to keep a ...
-2
votes
1answer
299 views

Illegal Service Endpoint error from Dataloader.io

I am wondering if anyone uses Dataloader.io which connects to SF instances. If so have you ever received an "Illegal service endpoint" error? This would also be a question directed to anyone who has ...
0
votes
3answers
438 views

Salesforce solution to ETL data from one org to another, preserve relationships, map data to new object types

I am seeking a tool that offers the features to 1. export data, using filters, from a legacy organization 2. map that data to a existing or new structures in a new org, example Leads with set of ...
1
vote
1answer
491 views

Can I UPSERT on Id using DBAmp?

I know I can upsert on an external Id in DBAmp. The DBAmp documentation makes a lot of reference to specifying the external Id in an upsert call, but no reference to making an upsert based on the ...
0
votes
2answers
6k views

ExactTarget: Synchronizing ExactTarget and Salesforce Contacts - Best practice?

Hello ExactTarget and Salesforce experts, This time, I need a little help in understanding how ExactTarget and Salesforce work together... In this question I will be referring to a previous question,...
1
vote
3answers
5k views

ExactTarget: Common data loading strategies?

Dear ExactTarget specialists, I am trying to get a hang of how the ExactTarget Marketing Cloud works, and I am struggling in finding information on a seemingly basic task: Loading data into the ...
3
votes
1answer
341 views

How to enable External Objects in Salesforce Developer Edition

I want to enable External Objects in my developer edition. How to do it, i was not able to see any settings ?
2
votes
1answer
333 views

how do we load huge attachments to salesforce content

i am looking to load multiple huge video files (100MB x 10) in separate files into the content object in salesforce. I intend to load the files into a particular library which is already existing. ...
3
votes
1answer
780 views

Copy Opportunities with LineItems with TalenD

One way to solve the datamigration challenge in Salesforce seems to be the usage of ETL-Tools. Looking around for a free and powerful approach, I found here at SFSE some recommendations of TalenD - It ...
8
votes
3answers
2k views

Datamigration Salesforce to Salesforce with TalenD - Best Practice for Self-Referreces

Assuming metadata is already identical, the data-transfer of complex models can still take hours or even days of manual work. Fortunately there are free tools like TalenD which can help to automate ...