Episode #125 of the Stack Overflow podcast is here. We talk Tilde Club and mechanical keyboards. Listen now

Questions tagged [bulk-api]

Bulk API is based on REST principles and is optimized for loading or deleting large sets of data. You can use it to query, insert, update, upsert, or delete a large number of records asynchronously by submitting batches which are processed in the background by Salesforce.

Filter by
Sorted by
Tagged with
0
votes
0answers
18 views

how to query job batches info bulk api 2.0

Before, using bulk api 1.0 endpoint. I could make request to get all job's batches like so: ` req.setEndpoint('callout:BulkApi' + '/' + jobId + '/batch'); req.setMethod('GET'); req.setHeader('...
2
votes
0answers
36 views

REST API Calls Consumption in Marketing Cloud [duplicate]

If 1 million records are pushed into a data extension via REST API, does this count as 1 call or would it consume many calls?
0
votes
1answer
12 views

Does bulk api 2.0 support deletion of data?

Salesforce documentation is contradictory. In documentation of Bulk API 1.0 it is mentioned that Use Bulk API 2.0 instead of Bulk API if you want a simplified process for inserting, updating, ...
2
votes
0answers
44 views

Is there a way to delete >1 Million records from a custom Big Object?

First thing that came to my mind was writing a Batch Apex to do this but I get this error. System.UnexpectedException: The requested operation is not supported by this SObject Deleting via Bulk API ...
0
votes
0answers
16 views

BULK API Status Not Found

A simple bulk API which I am trying to create a JOB, and I am getting the status "NOT FOUND" and code: 400. The same request working in the Workbench. Not sure what I am missing. bulkApiController....
0
votes
1answer
63 views

simple_salesforce - Cannot bulk insert more than 10 records at a time [closed]

I am using the simple_salesforce Python package. I tried bulk inserting 100 records using bulk.insert(), and did so without any errors. However, when I checked how many records were present after, ...
0
votes
1answer
24 views

Optimal Data Load Speeds

We are currently attempting to load a large amount of data, and are currently using the BulkAPI, with chunk size of 200 and batches of 2000. Is there documentation anywhere that would outline the ...
0
votes
1answer
50 views

Exporting of and capturing changes on a large set of records

We have to load the entire Salesforce Lead data(this data might be millions records)to external system using Bulk API. Once all the data loaded and we thought to initiated to catch the added/modified/...
0
votes
1answer
75 views

SalesForce Bulk API response to Pandas DataFrame [closed]

I'm a beginner with the Salesforce API and recently, I've been trying make bulk API requests and convert the response into a pandas DataFrame, however, the results I'm having a tough time with are ...
0
votes
1answer
61 views

Upsert using relationships

I have a custom object Relation__c which has two fields a__c and b__c both are lookups to the standard Account Object. The Account object has an external Id field called z__c If I have to use Bulk ...
1
vote
0answers
46 views

Salesforce Bulkv2.0 job failed with error message: Failure writing to File store

I executed a bulk job using the Salesforce Bulkv2 API. Operation: Upsert Status: Failed State Message: Failure writing to File store I can't find information on this error and am wondering what ...
1
vote
1answer
40 views

Will Bulk API be affected by System.isBatch()?

I have a trigger that needs to be run during a Bulk API insert/update of records but that needs to not run during an Batch Apex Job like: global class myBatchClass implements Database.Batchable<...
0
votes
0answers
71 views

Got “java.io.IOException: Premature EOF” error randomly when retrieve large data from Salesforce

When we use salesforce bulk query to retrieve data from salesforce module. There are more than 10 million records in the target module. we got this kind of error randomly: [FATAL]: local_project711....
1
vote
1answer
108 views

InvalidUrl Bulk API creating a bulk job using postman

URI i'm using is: https://yourInstance.salesforce.com/services/async/46.0/job so in my case example is https://cs89.salesforce.com/services/async/46.0/job but it still says InvalidUrl. X-Session-Id ...
1
vote
2answers
39 views

using SalesforceBulk API, batch_status() return 'state': 'Queued'

While searching the StackExchange for 'Queued' I found that most answers are related to apex code. In my case I'm using the SalesforceBulk API (through python). My scenario: When calling the ...
1
vote
1answer
60 views

Bulk API V1 Query - ResultId missing when running concurrent Bulk Jobs

When querying for the result ids of a batch on a closed Bulk (v1) query job, sometimes the result id is not returned; instead the full returned xml is: <result-list xmlns="http://www.force.com/...
1
vote
1answer
52 views

Uploading multiple batches in Bulk API 2.0

I am currently using Bulk API 2.0 to insert, update and delete data in Salesforce. What I am confused about is uploading more than 1 batch of CSV records to a job before it is closed? I create a ...
1
vote
0answers
48 views

Bulk data load jobs missing batches and stuck in Open state

I am having a problem with Bulk Data Load Jobs where they seem to be submitted without Batches and as such appear to get stuck in Open state until they are manually Aborted. This is similar to a ...
1
vote
0answers
30 views

Bulk Job Status - Failed vs Not Processed?

What are the use cases for setting a Bulk (version 1) job to a status of Failed vs Not Processed? Salesforce documentation gives the same description for both The batch failed to process the full ...
1
vote
2answers
75 views

Populating Big Objects from CSV

I need to create a client application where users can upload CSV files, which will then be used to populate Custom Big Objects. My problem is I'm not sure which API to use. The Salesforce ...
2
votes
2answers
321 views

How can I monitor the bulk API limit?

Salesforce limits you to 10,000 batches per 24-hour period. For reference: https://developer.salesforce.com/docs/atlas.en-us.salesforce_app_limits_cheatsheet.meta/salesforce_app_limits_cheatsheet/...
1
vote
1answer
61 views

How to enable Bulk API v2.0

We are loading data into Salesforce from Informatica and have enabled Bulk API option. But in the Salesforce Batch status pages, we see that v1 of the Bulk API is being used. We are using 41.0 ...
3
votes
1answer
319 views

Bulk API Error: UNABLE_TO_LOCK_ROW:unable to obtain exclusive access to this record or 124 records

During the process of loading 90,000 opportunities into Salesforce using the Bulk API, I get this error: UNABLE_TO_LOCK_ROW:unable to obtain exclusive access to this record or 124 records... After ...
0
votes
0answers
19 views

Querying bulk load status (Salesforce Connector) in IBM Infospehere Datatstage

Has anyone worked with Querying bulk load status (Salesforce Connector) in Datatstage. It is returning me duplicate records of the job. Basically same records 4 times as there are 4 batches in my job. ...
0
votes
0answers
59 views

Bulk API 2.0 Close Request Failing - Cannot specify query parameters in the resource

I am doing a POC on the BULK API and have run through this trailhead: https://trailhead.salesforce.com/en/content/learn/modules/api_basics/api_basics_bulk where you call the BULK API through WorkBench....
0
votes
0answers
93 views

JSforce bulk api version 2

I'm trying to use the bulk api from jsforce in nodejs using the methods mentioned here. When running this, I'm noticing that its creating a job with BulkV1. Is there a jsforce library that supports ...
0
votes
0answers
37 views

Failed to parse job: input contained no data Bulk API Error message

Tried to Abort a job with the below message. <?xml version="1.0" encoding="UTF-8"?> <jobInfo xmlns="http://www.force.com/2009/06/asyncapi/dataload"> <state>Aborted</state> &...
1
vote
2answers
151 views

API requests calculation on a bulk upsert costing 6 calls

I am using the simple-salesforce Python package to upsert records into our Salesforce instance. I am finding that each bulk API call counts as 6 API requests. Is this correct? Is there a way to reduce ...
1
vote
0answers
75 views

Python-driven Bulk API 2.0 hardDelete yields “errorMessage”: “InvalidBatch : InvalidBatch : The 'delete' batch must contain only ids”

I am trying to write a bit of python code to permanently delete some records using the Salesforce.com Bulk API v2. Using curl, I have success. I: create an Bulk API 2 hardDelete job PUT the file to ....
0
votes
1answer
112 views

Bulk API 2.0 trying to post new job, but request is redirected

I am trying to create bulk job using Bulk API 2.0, but my post request is redirected by salesforce to GET request. As a result, job is not created and I get /jobs/ingest GET response instead. I have ...
0
votes
1answer
76 views

Bulk API 2.0 Daily CSV upload, need new job every day?

Does a daily CSV upload using the Bulk API 2.0 require a new job created each day? Or can one job handle a new upload daily. Having a hard time finding this on the docs. I see the sample process ...
0
votes
1answer
70 views

Apex: An error has occured reading the CSV fileList index out of bounds: 2

I recieve this error when testing the bulk uploading that we have implemented on our SF environment Apex Class: public class CarrierUpdateController { public transient Blob fileContent {get;set;} ...
0
votes
0answers
161 views

Issue upserting Account Contact Relationship - INVALID_FIELD_FOR_INSERT_UPDATE:Unable to create/update fields: AccountId

I'm upserting Account Contact Relationships the first load, works fine and we are upserting on a customer external ID field. When the upsert is run a second time - we see this error in the logs: "...
1
vote
1answer
116 views

How to upload ContentVersion records using BulkAPI?

So I've been trying to follow the sample java app provided in the documentation to write some Java code to upload ContentVersion records (files) into Salesforce using the Bulk API. It should be so ...
2
votes
1answer
171 views

I am querying more than 2000 records. Is it a good idea to use the BULK API?

I'm new to the Salesforce community, so I apologize if this question is asked wrong. I was running into essentially the exact same problem mentioned in this post. Basically, I have a query that ...
2
votes
1answer
152 views

Bulk API 2.0 Upload for files bigger than 150Mb

I'm trying to use the Bulk API 2.0 to upload big files. I need to know how I have to upload the data in case the file converted to base64 exceeds the 150Mb allowed. After reading the documentation I'...
1
vote
1answer
375 views

Salesforce Rest API create account

We are using the Salesforce Rest API to integrate our external website with Salesforce Sales Cloud. When a user registers on our website, we create a contact record in Salesforce. The response to ...
0
votes
1answer
57 views

External Website integration with Salesforce

We have an external website that is integrated with Salesforce via REST API. On the website, when a user registers, a contact record is created and also a welcome email is sent right away. Users ...
0
votes
1answer
372 views

Can the Bulk API solve the CPU Time Limit Issue I am having

As it stands currently, I have created a scheduled apex job that is supposed to run nightly and compare records being imported into a 'staging' object against records already in custom objects, and ...
1
vote
1answer
245 views

DateTime values in Bulk Query results - difference between CSV and JSON formats

I'm running Bulk API queries in Python, using both the simple_salesforce and salesforce_bulk libraries. I've encountered a confusing result when querying DateTime fields. Given a simple_salesforce ...
1
vote
1answer
108 views

Bulk API 2.0 works in sandbox but broken in production

I'm trying to bulk import Task records using the Bulk API 2.0, which works perfectly fine in the sandbox, but fails with this error every time when I try to create the job in production: [{"errorCode"...
0
votes
0answers
38 views

Monitor import wizard for platform Users

My org has some Users who import data through import wizard. It works for them but they are not able to monitor it as they don't have permission to monitor bulk load, Neither can i give them the '...
2
votes
1answer
87 views

Exporting Related Object Records - Bulk Api / DataLoader

I am looking to export only case comments and notes related to particular standard and custom objects. Ex: All CaseComments for cases of a particular record type. All notes for a custom object with a ...
2
votes
0answers
170 views

How do I get the record ID's for a bulk data insert using sfdx CLI?

I'm trying to use sfdx-cli to perform bulk-insert jobs, but can't find a way to access the batch results on a per row level. I see that the command force:data:bulk:status informs you of how many ...
4
votes
0answers
65 views

SOQL query results differ on selecting from varying columns

I'm querying on Contact object where the results are varying on Bulk API vs querying on developer console. Total records on Contact is 997820. Query on developer console: select count(id) from ...
3
votes
0answers
175 views

Salesforce Bulk API v2.0 INVALID_SESSION_ID

Following the Salesforce Bulk API v2.0 documentation at: https://developer.salesforce.com/docs/atlas.en-us.api_bulk_v2.meta/api_bulk_v2/walkthrough_upload_data.htm https://developer.salesforce.com/...
0
votes
1answer
768 views

REST api to upload multiple notes and attachments at once

I am working on an app that allows customers to upload images, video, (even gif) into my app. Once the case is processed on my app, I want to place those media files into Salesforce. I have a case ...
0
votes
1answer
273 views

Trouble Using Bulk API 2.0 Multipart Request

I am sending up this payload --BOUNDARY Content-Type: application/json; charset=utf-8 Content-Disposition: form-data; name="job" {"columnDelimeter":",","contentType":"CSV","lineEnding":"\r\n","object"...
0
votes
1answer
341 views

Trouble with Creating a Job for Bulk API 2.0

I'm Using this documentation https://developer.salesforce.com/docs/atlas.en-us.api_bulk_v2.meta/api_bulk_v2/create_job.htm With this URI https://cs30.salesforce.com/services/async/44.0/jobs/ingest ...
1
vote
0answers
58 views

Staggered query of Salesforce bulk api from Ruby

I'm trying to do a staggered query using the Bulk API from a RoR app since the filter (WHERE App_Id__c IN :listOfIds) I'm using is over 4000 chars. The list of IDs I'm filtering on is quite long, so ...