Skip to main content

Questions tagged [bulk-api]

Bulk API is based on REST principles and is optimized for loading or deleting large sets of data. You can use it to query, insert, update, upsert, or delete a large number of records asynchronously by submitting batches which are processed in the background by Salesforce.

Filter by
Sorted by
Tagged with
1 vote
0 answers
10 views

DataLoader CSV Bulk API not loading field values if first processed record does not have all fields populated

Has anyone else ran into issues using DataLoader where if the first row of the CSV file that is loaded successfully does not have values for every possible field in the file, it will fail to load? For ...
SCVandal's user avatar
-1 votes
1 answer
28 views

Using SF Bulk API for Coupon Assignment

I am trying to understand how to use the SF Bulk API for coupon assignment. I am referencing the documentation https://tidbitsforu.com/send-sfmc-sfdc-using-ssjs-bulkapi2/ and want to understand the ...
Ryan Moravick's user avatar
1 vote
0 answers
47 views

Did the bulk 2.0 query change how it batches over the weekend and how do I fix it?

We have been doing a bulk v2 query for a long time now and suddenly saturday morning (May 25, 2024) it began behaving differently. Prior to saturday each query would create 2 total batches, one with 0 ...
Ahowell's user avatar
  • 25
0 votes
0 answers
27 views

Support for order by /limit with Bulk API 2.0 V2

I'm asking a question regarding SFDC Bulk API 2.0. As per the limitations mentioned here - https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/queries.htm#limits, using limit ...
javaFreak's user avatar
0 votes
0 answers
40 views

simple_salesforce bulk insert function causing a disconnect error

sf.bulk.object_name.insert(list_of_records,batch_size=100,use_serial=True) I'm using simple_salesforce to bulk insert records but once in a while it causes this error. ConnectionError: ('Connection ...
acs's user avatar
  • 1
0 votes
1 answer
22 views

How can we leverage API to bulk upload File Links with relation to parent records

We are trying to leverage Bulk API to upload File Links We create an Bulk API ingest job using the following URL: https://{{Domain}}/services/data/v59.0/jobs/ingest and Body: { "object" : ...
Patlatus's user avatar
  • 17.2k
0 votes
0 answers
73 views

Bulk API query - escaping quotes in JSON payload

I am building an app to access and curate data from a salesforce installation. We will be organizing manufacturing companies, but many companies inside the salesforce DB are non manufacturing. In the ...
Nicholas Finch's user avatar
2 votes
1 answer
41 views

Can I use Bulk API to automate insertion of Knowledge Data Category Assignment?

When I try to execute command sf bulk upsert for Knowledge__DataCategorySelection I receive an error No create/update access for object:Knowledge__DataCategorySelection. sf data upsert bulk -s ...
Patlatus's user avatar
  • 17.2k
0 votes
0 answers
86 views

simple_salesforce bulk query - timed out

I'm encountering timeout errors when fetching records from Salesforce via the simple_salesforce library and executing a SOQL query, particularly during bulk updates for a specific date. Currently, the ...
Prasath's user avatar
  • 11
0 votes
1 answer
67 views

How to set a date field in salesforce to empty through salesforce bulk api from python

How can I use the Salesforce Bulk API from Python to set a date field in Salesforce to be empty/null for multiple records in a bulk operation? I have tried with following None - request accepted and ...
Vanjith's user avatar
  • 101
0 votes
1 answer
84 views

Bulk API to query all data too slow

I am trying to write a function in Python that can query all Salesforce Object data. I'm utilizing the salesforce_bulk Python Library. This is an overview of what I've written: def ...
aayushmishra_'s user avatar
-1 votes
1 answer
484 views

How to get all the Bulk Data Load Jobs submitted by a particular user?

Want to find out if an integration user has submitted any bulk data load jobs in the org. https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/get_all_jobs.htm doesn't provide ...
Borz998's user avatar
  • 101
2 votes
1 answer
114 views

Bulk API V1 Query showing a batch size of only 1 for 144717 records. Why?

From Salesforce documentation and questions such as Bulk api query batch size limit is 10,000 records, it appears that the batch size limit is 10,000 records for V1 bulk API. Also listed here: https://...
Strong Like Bull's user avatar
0 votes
0 answers
38 views

Bulk API 2.0 and Attachments Upload [duplicate]

Does Bulk API 2.0 support Attachment upload related to Account (for example)? I checked the documentation and it shows Binary attachment upload using Bulk API and not V2.0. Reference link - https://...
SEuser's user avatar
  • 1,855
0 votes
0 answers
710 views

LWC: upload and process a CSV

I am developing a Lightning Web Component that uses the Bulk API 2.0 to insert a large amount of data to Salesforce, exposing the functionality to non-technical users without access to the Setup. So ...
Fabio Barcelona's user avatar
0 votes
1 answer
58 views

Extended Response Time with simple_salesforce Library's upsert method

Problem Statement: I'm encountering prolonged response times exceeding 30 seconds while using the simple_salesforce library to perform upsert operations in batches using the bulk functionality. The ...
Mahesh Patil's user avatar
0 votes
0 answers
124 views

Recommended way to retrieve large number of records using record IDs returned by getUpdated() call?

I'll start off by describing how I understand the intended use of the getUpdated method. The Salesforce docs recommend using the getUpdated() method from their data replication API to retrieve records ...
James McDonell's user avatar
0 votes
1 answer
809 views

How to investigate an InvalidBatch?

Forgive me, I'm the messenger: Our devs have copied our Demo data to their Local, and when sending to the Bulk Data API, it goes through fine. When our Demo sends the data automatically, we're getting ...
David Gerrard's user avatar
0 votes
0 answers
98 views

Trying to find objects that are capturing the row lock, bulk data load jobs, failed flows, etc

I'm trying to monitor the below issues. Could someone please help us to get insights on which object the below information gets captured. Row lock errors/issues Bulk Data load Jos errors/issues Audit ...
Bforce's user avatar
  • 6,828
0 votes
1 answer
406 views

Bulk Api 2.0 max 2 retries instead of 10

I recently started huge PricebookEntry bulk update, around 40 mln records in one of sandboxes where locks are unavoidable. I am relying on the documentation that 10 retries are guaranteed per batch: ...
Bithermal's user avatar
-1 votes
1 answer
26 views

Parent Field Lookup Via Text (No External id)

Just curious how dataloader.io allows the functionality to lookup parent record via text field , email field etc. https://prnt.sc/wb50K_LtH3mP Does dataloader.io queries all the parent id via these ...
Piyush Kalra's user avatar
0 votes
0 answers
117 views

Why is Account name exportable in bulk api but not billingaddress?

From what I read online compound fields are not exportable using bulk export. services/data/v58.0/query/?q=SELECT DurableId, IsCompound FROM FieldDefinition where EntityDefinitionId='Account' AND ...
Chakradar Raju's user avatar
1 vote
1 answer
137 views

Where are Bulk API queries to MetadataComponentDependency supported

The documentation suggests that you can query MetadataComponentDependency using the Bulk API. It seems to work fine in my scratch org sandboxes, but not in a DE org. Does anyone know if this is this a ...
Phil Hawthorn's user avatar
1 vote
2 answers
419 views

Bulk API Query Job in Apex with big response

I have a task to query a million records from one org and then upsert them in another org. I use a Bulk API query job to get all records. HttpRequest request = new HttpRequest(); request.setEndpoint('...
Marina's user avatar
  • 19
0 votes
1 answer
447 views

Postman API - Attachment is not a supported object

When running this Bulk V2 query in Postman I get the following error. Query: SELECT Id FROM Attachment WHERE ParentId = XXX Error: "errorCode": "INVALIDJOB", "message": &...
Michael SF's user avatar
0 votes
1 answer
278 views

Prevent CPU Time Exceeded Governor limit

I have a very small flow. It simply calls an apex action, then an update records element. This is set to run on create or update on the account object. Here's a picture: Although this flow is pretty ...
Luke Sharon's user avatar
1 vote
1 answer
580 views

How does Record Locking work in bulk uploads?

I am uploading about 800 records into salesforce using the salesforce inspector extension with the data import option. Per normal bulkification standards, the batches run in increments of 200 records ...
Luke Sharon's user avatar
4 votes
3 answers
1k views

Is there a *public-facing* list of GACK codes?

While Salesforce's internal processes are somewhat shrouded in mystery, we have been allowed a high-level look at the GACK process. What our team is noticing is that certain GACK IDs are consistent : ...
Rob Cowell's user avatar
-1 votes
2 answers
165 views

Bulk update of custom field value in salesforce object failing due to custom validations and triggers

I added a custom field to opportunity salesforce object. It's name is externalId__c. The field is added to the object. However when I am trying to update the value of externalId__c for all the records,...
Chitvan Mishra's user avatar
0 votes
1 answer
794 views

Running Apex in parallel

I have an Apex REST webservice that creates a contact and a community user when being called with some input data (username, email etc.). I need to import about 20k users. I want to save processing ...
DevelBase2's user avatar
-1 votes
1 answer
622 views

Token expiration for server-to-server flow

We have implemented a server-to-server flow in Java where our API server will make calls to Salesforce API. We followed the great example provided by Salesforce. However, there are two time-related ...
Eric Liprandi's user avatar
0 votes
1 answer
737 views

Simple-Salesforce: is there a way to bulk insert data on a lookup field without an external ID?

I previously posted this question: Simple-salesforce: perform a bulk insert on a lookup field In that thread I got the documentation answer for how to perform an update based on an external ID. In the ...
frequent user's user avatar
0 votes
1 answer
1k views

Simple-salesforce: perform a bulk insert on a lookup field

I am attempting to perform a bulk insert to a custom object in salesforce using the simple-salesforce library. I have a lookup field with a the api endpoint 'Account_Name__c', along with a few others. ...
frequent user's user avatar
1 vote
1 answer
656 views

simple-salesforce: perform a bulk query on a custom object

I have seen examples of how to perform a bulk query on a standard object like this: sf.bulk.Opportunity.query( "SELECT Id, Account.Name, Name, RecordType.Name, Type WHERE Id = 12345") I ...
frequent user's user avatar
0 votes
1 answer
3k views

How do I bulk update records using simple-salesforce?

I am successfully performing a bulk query operation using simple salesforce to obtain the Id's I want to work with, but when I perform a bulk update like this: data=[{'Id': '1', 'Date__c': '12/01/2022'...
frequent user's user avatar
1 vote
1 answer
111 views

What governs the longevity/availability of Bulk Data Load Job batch View Request and View Result links?

In pushing Bulk Data Load Jobs via Mulesoft, I've relied heavily on being able to inspect the results of jobs as they run via the Bulk Data Load Job Detail page in the Auto-Chunked Batches section. ...
J. Hochberg's user avatar
0 votes
1 answer
737 views

Bulk API jobs: Wait or retry?

I am using the Salesforce Bulk API in several solutions for working with Salesforce data outside of Salesforce. Based on experience and memory (which of course can be flawed), it seems to me that ...
Matthew Souther's user avatar
2 votes
1 answer
984 views

Bulk query from SFDX CLI - How to get all results

I'm querying a large (1+ million) number of records from the SFDX CLI: sfdx force:data:soql:query \ --targetusername '[email protected]' \ --soqlqueryfile "my_query.soql" \ --...
soapygopher's user avatar
0 votes
1 answer
135 views

Apply Id to the Detail record of the Master record in a trigger

Specifically, I'm trying to figure out the syntax to add the parent/master object id, to the child/detail record so the insert works without giving an error of malformed Id. I know the master name, ...
van Zylin's user avatar
0 votes
1 answer
472 views

Bulk API v1 using SOAP protocol

I need to import data in bulk using SOAP API (due to a limitation on client's middleware). Bulk API v2 - based on REST. Is Bulk API v1 also REST? Can I use v1 with SOAP protocol? Bulk API ...
DevelBase2's user avatar
0 votes
0 answers
490 views

Json Deserialization failed on token and has left off in the middle of parsing a row

I am trying to bulk load a csv file with 11000 records using Python with the simple-salesforce API. The error that I am running into is that when I try to load the file, I get this message: {'created':...
Perdue's user avatar
  • 121
0 votes
2 answers
486 views

How to check if an update is done by Rest API or Bulk API

We have a 3rd party system which updates records in our salesforce org on a daily basis. Is there a way to check if this system is using Rest API or Bulk API? The developer mentioned it runs on Roby ...
Michael Imas's user avatar
2 votes
1 answer
2k views

Unable to Obtain Failed Bulk API Records

I am trying to pull the failed records from a bulk job that I have using this API call: https://COMPANYNAME.my.salesforce.com/services/data/v56.0/jobs/ingest/{jobId}/failedResults This API call is ...
Perdue's user avatar
  • 121
0 votes
1 answer
452 views

Invalid query Locator

I have a database scheduled connection in MS PowerQuery (native from the tool) to retrieve data from Salesforce. They are at a maximum 7 tables (objects) and summed up or not they overcome 20k records....
Salesforce Administrator's user avatar
0 votes
1 answer
402 views

Apex Bulk API order of processing for CSV records

I am currently working on an existing integration for syncing price-book entries from an external system to Salesforce. The system is using Apex Bulk API.I already know that in Salesforce it is ...
RanRag's user avatar
  • 135
0 votes
2 answers
815 views

unable to lock rows when mass deleting

I am helping my company to delete millions of records from object 'Case' in one of our sandboxes. Now matter how big or small the batch size I set, i always receive the 'unable to lock row' error. ...
Kay's user avatar
  • 21
0 votes
1 answer
330 views

JSForce: upload different fields in same load

Is it possible to upload lots of records, specifying different fields using conn.bulk.load? E.g.: let accounts = []; let account1 = { Name : "Steve", AccountNumber : "123", ...
fred's user avatar
  • 3,420
0 votes
1 answer
386 views

Can I chain Bulk API jobs?

I have to load millions of records in a data migration process and I'm dealing with a parent object and a couple of custom child objects. After initial load, data will keep flowing, as Salesforce has ...
Stefano Luoni's user avatar
-1 votes
1 answer
220 views

How do I pass the record id in an update call to the Bulk API V1?

When I try to update records using the Bulk API V1, I receive a missing_argument statusCode with a 'Id not specified in an update call' message. I've been looking through the docs but I can't find ...
Rful's user avatar
  • 1
1 vote
1 answer
2k views

Python Simple-Salesforce - Fetch Bulk API Job Id in result

Is there some way to get Bulk API Job Id in job results? object_type = self.sf_connection.bulk.__getattr__('Case') results = objecttype._bulk_operation(use_serial = True, operation = 'delete', data = ...
Sukruti's user avatar
  • 462

1
2 3 4 5
9