Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [bulk-api]

Bulk API is based on REST principles and is optimized for loading or deleting large sets of data. You can use it to query, insert, update, upsert, or delete a large number of records asynchronously by submitting batches which are processed in the background by Salesforce.

0
votes
2answers
28 views

Populating Big Objects from CSV

I need to create a client application where users can upload CSV files, which will then be used to populate Custom Big Objects. My problem is I'm not sure which API to use. The Salesforce ...
2
votes
2answers
214 views

How can I monitor the bulk API limit?

Salesforce limits you to 10,000 batches per 24-hour period. For reference: https://developer.salesforce.com/docs/atlas.en-us.salesforce_app_limits_cheatsheet.meta/salesforce_app_limits_cheatsheet/...
1
vote
1answer
40 views

How to enable Bulk API v2.0

We are loading data into Salesforce from Informatica and have enabled Bulk API option. But in the Salesforce Batch status pages, we see that v1 of the Bulk API is being used. We are using 41.0 ...
3
votes
1answer
177 views

Bulk API Error: UNABLE_TO_LOCK_ROW:unable to obtain exclusive access to this record or 124 records

During the process of loading 90,000 opportunities into Salesforce using the Bulk API, I get this error: UNABLE_TO_LOCK_ROW:unable to obtain exclusive access to this record or 124 records... After ...
0
votes
0answers
13 views

Querying bulk load status (Salesforce Connector) in IBM Infospehere Datatstage

Has anyone worked with Querying bulk load status (Salesforce Connector) in Datatstage. It is returning me duplicate records of the job. Basically same records 4 times as there are 4 batches in my job. ...
0
votes
0answers
25 views

Bulk API 2.0 Close Request Failing - Cannot specify query parameters in the resource

I am doing a POC on the BULK API and have run through this trailhead: https://trailhead.salesforce.com/en/content/learn/modules/api_basics/api_basics_bulk where you call the BULK API through WorkBench....
0
votes
0answers
20 views

JSforce bulk api version 2

I'm trying to use the bulk api from jsforce in nodejs using the methods mentioned here. When running this, I'm noticing that its creating a job with BulkV1. Is there a jsforce library that supports ...
0
votes
0answers
15 views

Failed to parse job: input contained no data Bulk API Error message

Tried to Abort a job with the below message. <?xml version="1.0" encoding="UTF-8"?> <jobInfo xmlns="http://www.force.com/2009/06/asyncapi/dataload"> <state>Aborted</state> &...
1
vote
2answers
67 views

API requests calculation on a bulk upsert costing 6 calls

I am using the simple-salesforce Python package to upsert records into our Salesforce instance. I am finding that each bulk API call counts as 6 API requests. Is this correct? Is there a way to reduce ...
1
vote
0answers
26 views

Python-driven Bulk API 2.0 hardDelete yields “errorMessage”: “InvalidBatch : InvalidBatch : The 'delete' batch must contain only ids”

I am trying to write a bit of python code to permanently delete some records using the Salesforce.com Bulk API v2. Using curl, I have success. I: create an Bulk API 2 hardDelete job PUT the file to ....
0
votes
1answer
32 views

Bulk API 2.0 trying to post new job, but request is redirected

I am trying to create bulk job using Bulk API 2.0, but my post request is redirected by salesforce to GET request. As a result, job is not created and I get /jobs/ingest GET response instead. I have ...
0
votes
1answer
35 views

Bulk API 2.0 Daily CSV upload, need new job every day?

Does a daily CSV upload using the Bulk API 2.0 require a new job created each day? Or can one job handle a new upload daily. Having a hard time finding this on the docs. I see the sample process ...
0
votes
1answer
32 views

Apex: An error has occured reading the CSV fileList index out of bounds: 2

I recieve this error when testing the bulk uploading that we have implemented on our SF environment Apex Class: public class CarrierUpdateController { public transient Blob fileContent {get;set;} ...
0
votes
0answers
79 views

Issue upserting Account Contact Relationship - INVALID_FIELD_FOR_INSERT_UPDATE:Unable to create/update fields: AccountId

I'm upserting Account Contact Relationships the first load, works fine and we are upserting on a customer external ID field. When the upsert is run a second time - we see this error in the logs: "...
1
vote
1answer
36 views

How to upload ContentVersion records using BulkAPI?

So I've been trying to follow the sample java app provided in the documentation to write some Java code to upload ContentVersion records (files) into Salesforce using the Bulk API. It should be so ...
2
votes
1answer
96 views

I am querying more than 2000 records. Is it a good idea to use the BULK API?

I'm new to the Salesforce community, so I apologize if this question is asked wrong. I was running into essentially the exact same problem mentioned in this post. Basically, I have a query that ...
2
votes
1answer
84 views

Bulk API 2.0 Upload for files bigger than 150Mb

I'm trying to use the Bulk API 2.0 to upload big files. I need to know how I have to upload the data in case the file converted to base64 exceeds the 150Mb allowed. After reading the documentation I'...
1
vote
1answer
187 views

Salesforce Rest API create account

We are using the Salesforce Rest API to integrate our external website with Salesforce Sales Cloud. When a user registers on our website, we create a contact record in Salesforce. The response to ...
0
votes
1answer
29 views

External Website integration with Salesforce

We have an external website that is integrated with Salesforce via REST API. On the website, when a user registers, a contact record is created and also a welcome email is sent right away. Users ...
0
votes
1answer
106 views

Can the Bulk API solve the CPU Time Limit Issue I am having

As it stands currently, I have created a scheduled apex job that is supposed to run nightly and compare records being imported into a 'staging' object against records already in custom objects, and ...
1
vote
1answer
88 views

DateTime values in Bulk Query results - difference between CSV and JSON formats

I'm running Bulk API queries in Python, using both the simple_salesforce and salesforce_bulk libraries. I've encountered a confusing result when querying DateTime fields. Given a simple_salesforce ...
1
vote
1answer
67 views

Bulk API 2.0 works in sandbox but broken in production

I'm trying to bulk import Task records using the Bulk API 2.0, which works perfectly fine in the sandbox, but fails with this error every time when I try to create the job in production: [{"errorCode"...
0
votes
0answers
23 views

Monitor import wizard for platform Users

My org has some Users who import data through import wizard. It works for them but they are not able to monitor it as they don't have permission to monitor bulk load, Neither can i give them the '...
2
votes
1answer
62 views

Exporting Related Object Records - Bulk Api / DataLoader

I am looking to export only case comments and notes related to particular standard and custom objects. Ex: All CaseComments for cases of a particular record type. All notes for a custom object with a ...
1
vote
0answers
119 views

How do I get the record ID's for a bulk data insert using sfdx CLI?

I'm trying to use sfdx-cli to perform bulk-insert jobs, but can't find a way to access the batch results on a per row level. I see that the command force:data:bulk:status informs you of how many ...
4
votes
0answers
61 views

SOQL query results differ on selecting from varying columns

I'm querying on Contact object where the results are varying on Bulk API vs querying on developer console. Total records on Contact is 997820. Query on developer console: select count(id) from ...
3
votes
0answers
128 views

Salesforce Bulk API v2.0 INVALID_SESSION_ID

Following the Salesforce Bulk API v2.0 documentation at: https://developer.salesforce.com/docs/atlas.en-us.api_bulk_v2.meta/api_bulk_v2/walkthrough_upload_data.htm https://developer.salesforce.com/...
0
votes
1answer
369 views

REST api to upload multiple notes and attachments at once

I am working on an app that allows customers to upload images, video, (even gif) into my app. Once the case is processed on my app, I want to place those media files into Salesforce. I have a case ...
0
votes
1answer
172 views

Trouble Using Bulk API 2.0 Multipart Request

I am sending up this payload --BOUNDARY Content-Type: application/json; charset=utf-8 Content-Disposition: form-data; name="job" {"columnDelimeter":",","contentType":"CSV","lineEnding":"\r\n","object"...
0
votes
1answer
212 views

Trouble with Creating a Job for Bulk API 2.0

I'm Using this documentation https://developer.salesforce.com/docs/atlas.en-us.api_bulk_v2.meta/api_bulk_v2/create_job.htm With this URI https://cs30.salesforce.com/services/async/44.0/jobs/ingest ...
1
vote
0answers
41 views

Staggered query of Salesforce bulk api from Ruby

I'm trying to do a staggered query using the Bulk API from a RoR app since the filter (WHERE App_Id__c IN :listOfIds) I'm using is over 4000 chars. The list of IDs I'm filtering on is quite long, so ...
4
votes
1answer
47 views

Transformation Spec limitation in Bulk API v1.0

We're using Transformation Spec feature of the bulk api when uploading records: https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/asynch_api_mapping.htm This allows us to ...
1
vote
1answer
169 views

Bulk API 1.0 - use Workbench

How can I use Bulk API 1.0 (for query) with Salesforce Workbench (or Postman) ? I found that doc explaining Bulk API 1.0 but only with cURL, and I'd like to use Workbench or Postman if possible, but ...
2
votes
1answer
768 views

Setting the batch size via Bulk API

I'm using the Bulk API to make updates to ~50k records. I'm splitting those up into jobs of about 5k apiece, but I was hoping there'd be a way to control the batch size similar to that of using ...
4
votes
2answers
230 views

Updating record from Ruby on Rails to Salesforce

I'm using a Ruby gem that utilizes the Salesforce Bulk API and a few sidekiq workers to update records within Salesforce and am running into a UNABLE_TO_LOCK_ROW error. The issue stems from the ...
1
vote
2answers
107 views

Salesforce Bulk API Unable to lock row

I'm currently using the Salesforce Bulk API within a Rails app to update a custom object in Salesforce. This works fine when I send a single record through, but when I batch in sets of 200, I get ...
2
votes
1answer
290 views

Does Salesforce Bulk API 2.0 accept JSON as the contentType?

I see that Bulk API 1.0 supports JSON payload as the content type for insert operations. However, I cannot ascertain if Bulk API 2.0 also supports JSON. In my Job Create body I've tried sending: { "...
0
votes
1answer
64 views

Mass Update Records - AWS S3

Currently, I utilize an AWS endpoint that returns a small JSON response based on my request. I am considering updating all of my records (300,000+) daily. My AWS counterparts can generate a JSON ...
1
vote
1answer
675 views

How to get the profile name and role name from User object

We already have a soql query to retrieve the User object (which returns the role id and profile id) was wondering if we could retrieve the RoleName and ProfileName from within the same query instead ...
6
votes
1answer
275 views

Providing multiple batches to the Bulk API 2.0

We're attempting to create multi-batch jobs in the Bulk API 2.0. Our previous single-batch workflow was to do: POST /services/data/v43.0/jobs/ingest PUT /services/data/v43.0/jobs/ingest/<job-id>...
0
votes
1answer
146 views

Bulk Api parent child relation

i am trying to use Bulk Api to create a case. Case object contains Account,other custom child objects and Account contains Contact. How can i insert/update/upsert this object structure using BulkApi ...
1
vote
1answer
162 views

Salesforce Bulk APi Session Id

I have used the salesforce REST API a ton in the past, but I am at the point where I need more speed for fetching/inserting/updating a large number of records at once. I have a remote application ...
0
votes
2answers
193 views

How Can I mass delete Account Records with a specific Record Type in Salesforce using Workbench?

I tried to delete Account Records using workbench and it gives me this error: Failed: InvalidBatch : Referenced file "request.txt" is missing or is a directory I am not able to understand how to ...
0
votes
1answer
195 views

Bulk API with PK-Chunking creates huge sets of batches when query is with where clause and subset of the records needs to be extracted

We have a Java API which uses Bulk API to extract records from an Object. The "select query" has a where clause, which should extract a subset of records, to honour the where clause, but we see that ...
2
votes
2answers
257 views

Using bulk API, do seperate serial batches still run parallel to eachother?

I have to load several million child records distributed over about 2000 parent records, so obviously I'm running into locking issues. I'm trying to find a way to avoid locks as much as possible, so I ...
0
votes
0answers
48 views

How do the Bulk API Jobs Status work?

I'm currently automating some data migrations with the SFDX CLI and I came upon a situation which confused me. While loading data with the command sfdx force:data:bulk:upsert and checking it with the ...
0
votes
1answer
55 views

null result in bulk api 2

I followed the insert walkthrough in the bulk api 2 docs. But when I checked the results I got 0 records processed and an unhelpful status of null:InternalServerError : null I toyed with the ...
0
votes
1answer
63 views

Does Bulk API 2.0 support field mapping?

Does Bulk API 2.0 support field mapping like old version as per below link? https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/asynch_api_mapping.htm
0
votes
0answers
285 views

Retrieve large data sets from salesforce using Rest API or Bulk API

We have external system which retrieves the data from Salesforce by using Rest Api. It was working fine till the return resultSet is limited. However, when we are working on large data set it works as ...
1
vote
1answer
692 views

Uploading files to SFDC attachment object using REST call

I have requirement to upload files to SFDC attachments object. I am making REST call from my Java code to SFDC with required details. curl -X POST \ https://ap.salesforce.com/services/data/v29.0/...