Questions tagged [etl]

ETL stands for Extract, Transform, Load. It refers to a process of data-migration or data-integration.

Filter by
Sorted by
Tagged with
0 votes
0 answers
33 views

Potential solutions for syncing an org with Person Accounts enabled with another with Person Accounts disabled

I am setting up a new org with the Requirement that Person Accounts are Disabled. Ideally, I would like when an Account gets created/edited in the new org, an Account gets created/edited accordingly ...
Someone's user avatar
1 vote
0 answers
164 views

SystemModStamp not updated after field type changed

After changing the type of a field from "Rich Text" to "Plain Text", Salesforce automatically stripped out the HTML tags used to style the values (e.g. from <p>Test value<...
William Lewis's user avatar
0 votes
1 answer
419 views

Informatica job failing with UNABLE_TO_LOCK_ROW:unable to obtain exclusive access to this record or 1 records: 001

Our Contact model is Private and there is a relationship with the Account object but it is a Lookup and NOT Master-Detail. We also have a custom setting which makes sure that not Triggers are running ...
Art S's user avatar
  • 301
3 votes
1 answer
478 views

Can you change SFMC Subscriber Key w/o SF Support?

Do you need SFMC Support to change the current subscriber id field from one existing field to another, no data migration or changes. And if so, is this still considered a rekey? Context: We are ...
John McKenney's user avatar
1 vote
1 answer
944 views

Is there a Salesforce data-loading/ETL tool that uses Bulk API V2.0? [closed]

Is there a data-loading/ETL tool that uses Salesforce's Bulk API v2.0? I see that both Data Loader and dataloader.io, in Bulk mode, still only use Bulk API v1.0. And please do NOT say "Workbench&...
Ezra Kenigsberg's user avatar
3 votes
1 answer
292 views

Integration design: ETL vs. ETL + Apex

We need to load large volumes of data from external vendors into our Salesforce org on a daily basis. Because the format in which each vendor provides the data is different, we use an ETL tool to ...
Brett Valentine's user avatar
0 votes
1 answer
1k views

Running into below at informatica error when running informatica jobs. AT salesforce end login history shows success [closed]

Error - Severity Timestamp Node Thread Message Code Message ERROR 7/1/2020 7:20:23 PM node02_xxxxx READER_2_1_1 JAVA PLUGIN_1762 [ERROR] com.informatica.powercenter.sdk.SDKException:...
SFDC Naruto's user avatar
0 votes
1 answer
94 views

user training enviroment

We're in the process of researching how to setup a user training environment. We're currently doing user training in the production org, and want to get a away from that. We've got over 2,500 users so ...
Bob Nerren's user avatar
0 votes
1 answer
425 views

How should I specify a boolean value in SalesForce input in Pentaho Spoon?

UPDATE: I got passed the error in Pentaho, but I still need help. Specifically, I modified the datatype of the IsActive field in my LDAP Input and Excel Output widgets. Now when I set the value of ...
D W Langham's user avatar
1 vote
0 answers
215 views

Can Jitterbit (or any ETL tool) do field-by-field "insert null values" without using the bulk API?

I can see that when an ETL tool is using the Bulk API, there isn't a global "insert null values" setting and you have to explicitly set cells to #N/A to get them to overwrite to null. That's nice, ...
k..'s user avatar
  • 1,187
6 votes
2 answers
357 views

Transformation Spec limitation in Bulk API v1.0

We're using Transformation Spec feature of the bulk api when uploading records: https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/asynch_api_mapping.htm This allows us to ...
Matt and Neil's user avatar
0 votes
1 answer
940 views

Managing FTPs for multiple business units

I've run into an issue with the amount of licenses I have available to use in out ETL generator (Dell Boomi). Using this to push data into a 5 different business units and file dropping to the ...
Tom Callahan's user avatar
  • 1,407
7 votes
1 answer
6k views

Change Data Capture vs Platform Events vs Replication API vs Streaming API vs Batch Data Synchronization [closed]

I have a requirement to sync Salesforce data from 2 objects to Datawarehouse and insert/update data from Datawarehouse to Salesforce.We want this data sync to be realtime for this application.Data ...
sfdc's user avatar
  • 13.6k
0 votes
0 answers
48 views

Examining A Data Load's Tentative Results Without Really Loading Data

Let's say I have a "Contact" object full of 50,000 records, 30,000 of which have a value in "MyExternalId__c." And then I have a CSV file full of 10,000 records, all of which have a value in "...
k..'s user avatar
  • 1,187
1 vote
1 answer
171 views

Help Combining SOQL Queries in ETL Tool

I'm using a SOQL query in an ETL tool to extract Account data from Salesforce and ultimately map it to our ERP system. The business has come up with two different use cases for extracting data in the ...
Chris Powers's user avatar
1 vote
1 answer
72 views

Cannot see chatter feed when a field is updated by ETL

I have enabled tracking on some fields of product table, and would like to receive a chatter feed when I follow a record and there is a change in those fields. If I change manually the data I ...
user41687's user avatar
1 vote
0 answers
268 views

Import Users in Salesforce Error when User licenses limit exceeded

With Talend Open Studio for Data Integration, the tSalesforceOutputBulkExec component is used to import users in Salesforce. I tested the import of 1000 new users whith only 30 user licences ...
Henri's user avatar
  • 61
0 votes
2 answers
219 views

Unexpected Error Parsing Query using Like Clause

I am attempting to test a query being used in an external application with salesforce integration where this query was generating a 'malformed query' error but I am running into an issue where the ...
Geowil's user avatar
  • 101
0 votes
2 answers
432 views

Command Line Apex Data Loader

any one worked on command Line apex data loader in windows system, I got an error, when I am checking the Verify encrypted command. C:\Program files\salesforce.com\data loader\bin>Encrypt.bat –v I ...
SFDC's user avatar
  • 11
1 vote
0 answers
64 views

Can an "SFDC changed data capture" by an ETL tool be made 100% reliable? [duplicate]

We've implemented an ETL extraction out of SFDC using the "Change data capture" mechanism with SFDC as the Data Master (described here). We do daily delta extractions using a filter on systemmodstamp ...
Guy Clairbois's user avatar
1 vote
1 answer
4k views

what is the best ETL tool or approach to use to perform against a large data set from SFDC?

I have to perform some ETL process against SFDC data (opps, activities, leads, etc) where the SFDC data needs to be mapped to an excel mapping file and an output csv or txt file needs to be created. ...
Mauricio.Ramos1979's user avatar
1 vote
0 answers
65 views

How to check used Module or Object name for the Salesforce report?

I have a report which is about Quotes in Salesforce created by one of the user, now I am trying to pull that report data using one of ETL tool talend using SOAP API's. But the issue is report are not ...
Sharad's user avatar
  • 111
2 votes
1 answer
258 views

Salesforce to Salesforce ETL - Automatic Data Transfers

My team is working on migrating to a new Org, from our previous Org. However, we need to use both and have the same data in both, as we will be rolling out clients in batches into the new Org, before ...
Mowrite's user avatar
  • 69
0 votes
1 answer
275 views

Loading files to Documents : Standard object

Loaded some external files in to the sandbox using dataloader. Specified the path of the file in the Body column. The documents got loaded successfully. I have tried the same from one datastage job. ...
cloudy-ritz's user avatar
  • 2,583
1 vote
1 answer
118 views

User Lock Out (Python/Beatbox)

I'm currently implementing a solution using python to bring in information via the Beatbox module for python. http://tomhayden3.com/2013/08/04/salesforce-python/ I got it to write successfully to a ...
Felipe Eduardo's user avatar
6 votes
2 answers
1k views

Is ETL/script the best way to create SQL database from SF?

At our organization we would like to set up a SQL copy of our Salesforce instance for two reasons: 1) the app we are using in Salesforce is shutting down (Common Ground) and we we want to keep a ...
kd7iwp's user avatar
  • 233
-2 votes
1 answer
604 views

Illegal Service Endpoint error from Dataloader.io

I am wondering if anyone uses Dataloader.io which connects to SF instances. If so have you ever received an "Illegal service endpoint" error? This would also be a question directed to anyone who has ...
dodegaard's user avatar
  • 101
0 votes
3 answers
584 views

Salesforce solution to ETL data from one org to another, preserve relationships, map data to new object types

I am seeking a tool that offers the features to 1. export data, using filters, from a legacy organization 2. map that data to a existing or new structures in a new org, example Leads with set of ...
Alexx's user avatar
  • 115
1 vote
1 answer
716 views

Can I UPSERT on Id using DBAmp?

I know I can upsert on an external Id in DBAmp. The DBAmp documentation makes a lot of reference to specifying the external Id in an upsert call, but no reference to making an upsert based on the ...
Dominic's user avatar
  • 3,618
1 vote
2 answers
7k views

ExactTarget: Synchronizing ExactTarget and Salesforce Contacts - Best practice?

Hello ExactTarget and Salesforce experts, This time, I need a little help in understanding how ExactTarget and Salesforce work together... In this question I will be referring to a previous question,...
donmartin's user avatar
  • 165
1 vote
3 answers
6k views

Common data loading strategies?

I am trying to get a hang of how the Salesforce Marketing Cloud works, and I am struggling in finding information on a seemingly basic task: Loading data into the platform. These questions may be ...
donmartin's user avatar
  • 165
3 votes
1 answer
371 views

How to enable External Objects in Salesforce Developer Edition

I want to enable External Objects in my developer edition. How to do it, i was not able to see any settings ?
Shaik's user avatar
  • 31
2 votes
1 answer
514 views

how do we load huge attachments to salesforce content

i am looking to load multiple huge video files (100MB x 10) in separate files into the content object in salesforce. I intend to load the files into a particular library which is already existing. ...
Anil Shivaraj's user avatar
2 votes
1 answer
1k views

Copy Opportunities with LineItems with TalenD

One way to solve the datamigration challenge in Salesforce seems to be the usage of ETL-Tools. Looking around for a free and powerful approach, I found here at SFSE some recommendations of TalenD - It ...
Uwe Heim's user avatar
  • 28.3k
7 votes
3 answers
3k views

Datamigration Salesforce to Salesforce with TalenD - Best Practice for Self-Referreces

Assuming metadata is already identical, the data-transfer of complex models can still take hours or even days of manual work. Fortunately there are free tools like TalenD which can help to automate ...
Uwe Heim's user avatar
  • 28.3k