Questions tagged [bulk-api]

Bulk API is based on REST principles and is optimized for loading or deleting large sets of data. You can use it to query, insert, update, upsert, or delete a large number of records asynchronously by submitting batches which are processed in the background by Salesforce.

Filter by
Sorted by
Tagged with
0
votes
1answer
7 views

Importing 40k PDF as attchments

I have 40k PDF's in windows shared drive. Each pdf should be attached to parent account. The name of each pdf is an external ID in salesforce. e.g AA123.pdf corresponds to AccountRecordId '...
0
votes
1answer
36 views

how to query job batches info bulk api 2.0

Before, using bulk api 1.0 endpoint. I could make request to get all job's batches like so: ` req.setEndpoint('callout:BulkApi' + '/' + jobId + '/batch'); req.setMethod('GET'); req.setHeader('...
2
votes
1answer
39 views

Bulk API vs Bulk API 2.0 Query Length

We've been using the BulkAPI (XML/SOAP) successfully for several months now and were looking to migrate over to the BulkAPI v2.0. However, when submitting a job (queryAll) to the 2.0 API we're ...
1
vote
1answer
365 views

Bulk API - asynchronous processing

I have a question regarding the Bulk API. It is stated that the Batches are processed asynchronously by Salesforce. I think it is meant that sending multiple batches for one job would be imported ...
8
votes
1answer
3k views

Problem creating Job in Bulk API

I have been successfully able to use REST API for my application but I found that Bulk API will be better for my application. So, now I am trying to switch to Bulk API but I am stuck at the first step....
0
votes
1answer
29 views

Bulk API library for Java

I searched on the internet for a bulk API library for Java, but I could not find anything relevant. Do you know any bulk API library for Java?
0
votes
1answer
23 views

how we know which version to pass in the bulk API

I am integrating the SF via connected APP and I'm trying to do bulk query and i followed the document and got to know how to achieve. My question is, how can i know which version should i pass in the ...
0
votes
1answer
22 views

Query “Bulk Data Load Jobs” IDs

Is there a way to use WorkBench/Apex/Rest-Explorer to query all "Bulk Data Load Jobs" IDs for last X days? Use Case - We want to set up some logs and monitoring on different users consuming our org ...
1
vote
1answer
26 views

WhoId, OwnerId and WhatId CSV Headers?

Polymorphic & Relationship Fields I'm trying to insert a task via Bulk API and providing the below csv headers, but getting Malformed_ID error. Owner:User.FederationIdentifier Contact:Who.Id ...
0
votes
1answer
28 views

BULK API Status Not Found

A simple bulk API which I am trying to create a JOB, and I am getting the status "NOT FOUND" and code: 400. The same request working in the Workbench. Not sure what I am missing. bulkApiController....
3
votes
2answers
532 views

BULK API cURL commands to GET 100k records from Account

curl "https://xxx.salesforce.com/services/data/v35.0/query/?q=SELECT+Id,+Name,+Phone+FROM+Account" -H "Authorization: Bearer <access token> " But this only fetching 2000 records. I need all ...
0
votes
2answers
1k views

Bulk Query with PK Chunking enabled sometimes does not return all the batches

The requirement is to use Bulk Query API with PK Chunking enabled, and to create CVS files for each batch with the chunk-size For example, in the Account Object if I have 80,000 records, and have the "...
1
vote
1answer
539 views

Push & pull data with sfdx commands

We were trying to export & import data from a sandbox using the sfdx tree export command. Even after going through the different links on google I could not understand how will we export a ...
0
votes
1answer
401 views

Deserialize BulkAPI XML response to QueryResult

Is there anyway to deserialize bulkAPI response(XML) to Standard QueryResult object? I am using C# as backend and PartnerAPI of SFDC. See below XML. I am getting "queryResult xmlns='http://www.force....
1
vote
2answers
309 views

How to set the concurrencyMode using the new Bulk API 2.0

I've read the documentation regarding the new Bulk API 2.0 but I haven't found the way to send a request with the parameter concurrencyMode and set it to Serial instead of Parellel. Can you help me ? ...
4
votes
2answers
434 views

Retrieve ActivityHistory via Bulk API?

I'm trying to download all of the ActivityHistories from our SFDC account. I would like to use the Bulk API to avoid hitting the API rate limit for the day. I'm using the following query to do so: ...
0
votes
1answer
717 views

How to abort or close bulk API jobs from api?

Salesforce support requested to abort bulk data jobs from API, we tried doing it via UI, but salesforce support said it did not work! looking for ways to do it via rest, soap or any other ways
0
votes
1answer
956 views

Bulk API 2.0 ---ClientInputError : LineEnding is invalid on user data.

getting error while inserting account using Bulk API 2.0 using workbench ClientInputError : LineEnding is invalid on user data. Current LineEnding setting is LF Csv Data Name,Description,...
0
votes
1answer
114 views

Bulk API 2.0 Close Request Failing - Cannot specify query parameters in the resource

I am doing a POC on the BULK API and have run through this trailhead: https://trailhead.salesforce.com/en/content/learn/modules/api_basics/api_basics_bulk where you call the BULK API through WorkBench....
2
votes
0answers
88 views

Is there a way to delete >1 Million records from a custom Big Object?

First thing that came to my mind was writing a Batch Apex to do this but I get this error. System.UnexpectedException: The requested operation is not supported by this SObject Deleting via Bulk API ...
2
votes
0answers
41 views

REST API Calls Consumption in Marketing Cloud [duplicate]

If 1 million records are pushed into a data extension via REST API, does this count as 1 call or would it consume many calls?
0
votes
1answer
381 views

Trouble with Creating a Job for Bulk API 2.0

I'm Using this documentation https://developer.salesforce.com/docs/atlas.en-us.api_bulk_v2.meta/api_bulk_v2/create_job.htm With this URI https://cs30.salesforce.com/services/async/44.0/jobs/ingest ...
0
votes
1answer
39 views

Does bulk api 2.0 support deletion of data?

Salesforce documentation is contradictory. In documentation of Bulk API 1.0 it is mentioned that Use Bulk API 2.0 instead of Bulk API if you want a simplified process for inserting, updating, ...
4
votes
1answer
541 views

BULK API -PK Chunking Header Query - job content type : application/xml

Is it possible to use PK Chunking Header for a Query job of type XML. It works with CSV and when i pass it for xml jobs it fails and gives this error InternalServerError : PKChunking failed. ...
0
votes
1answer
84 views

simple_salesforce - Cannot bulk insert more than 10 records at a time [closed]

I am using the simple_salesforce Python package. I tried bulk inserting 100 records using bulk.insert(), and did so without any errors. However, when I checked how many records were present after, ...
0
votes
1answer
1k views

Bulk Api error InvalidBatch : Field name not found

I have a custom field in Lead as well as contact with same API name. The data in this field is supposed to be populated via integration service layer[written in Java]. the issue is when the data is ...
0
votes
1answer
991 views

How to get error reason for bulk requests with failed records, via API

After a Bulk API upsert, I can inspect the batch after the fact and see that my 4 records failed. { 'apexProcessingTime': '0', 'apiActiveProcessingTime': '1', 'createdDate': '2017-07-21T15:33:47.000Z'...
0
votes
1answer
25 views

Optimal Data Load Speeds

We are currently attempting to load a large amount of data, and are currently using the BulkAPI, with chunk size of 200 and batches of 2000. Is there documentation anywhere that would outline the ...
1
vote
4answers
2k views

Integrating SQL Table Data into SalesForce Custom Object [closed]

Does anyone know whether it is possible to migrate SQL Table data into Salesforce custom object? Thanks in Advance.
0
votes
1answer
72 views

Upsert using relationships

I have a custom object Relation__c which has two fields a__c and b__c both are lookups to the standard Account Object. The Account object has an external Id field called z__c If I have to use Bulk ...
0
votes
1answer
52 views

Exporting of and capturing changes on a large set of records

We have to load the entire Salesforce Lead data(this data might be millions records)to external system using Bulk API. Once all the data loaded and we thought to initiated to catch the added/modified/...
3
votes
1answer
432 views

Bulk API Error: UNABLE_TO_LOCK_ROW:unable to obtain exclusive access to this record or 124 records

During the process of loading 90,000 opportunities into Salesforce using the Bulk API, I get this error: UNABLE_TO_LOCK_ROW:unable to obtain exclusive access to this record or 124 records... After ...
0
votes
1answer
129 views

SalesForce Bulk API response to Pandas DataFrame [closed]

I'm a beginner with the Salesforce API and recently, I've been trying make bulk API requests and convert the response into a pandas DataFrame, however, the results I'm having a tough time with are ...
1
vote
0answers
80 views

Salesforce Bulkv2.0 job failed with error message: Failure writing to File store

I executed a bulk job using the Salesforce Bulkv2 API. Operation: Upsert Status: Failed State Message: Failure writing to File store I can't find information on this error and am wondering what ...
4
votes
3answers
2k views

REST OAuth connection for Bulk API queries

Is it possible to authenticate an OAuth app for the user and then make Bulk API queries on their behalf? The results are easily going to be more than 20k records each authenticated user. When I have ...
1
vote
2answers
2k views

Bulk API: using Workbench InvalidSessionId (Unable to find session id)

I'm following this (Bulk Api) Trailhead, I have valid SessionId and when I try to authenticate I'm getting the following error: I have created few records using the same SessionId and I know its a ...
1
vote
1answer
63 views

Will Bulk API be affected by System.isBatch()?

I have a trigger that needs to be run during a Bulk API insert/update of records but that needs to not run during an Batch Apex Job like: global class myBatchClass implements Database.Batchable<...
0
votes
0answers
132 views

Got “java.io.IOException: Premature EOF” error randomly when retrieve large data from Salesforce

When we use salesforce bulk query to retrieve data from salesforce module. There are more than 10 million records in the target module. we got this kind of error randomly: [FATAL]: local_project711....
1
vote
1answer
166 views

InvalidUrl Bulk API creating a bulk job using postman

URI i'm using is: https://yourInstance.salesforce.com/services/async/46.0/job so in my case example is https://cs89.salesforce.com/services/async/46.0/job but it still says InvalidUrl. X-Session-Id ...
1
vote
1answer
110 views

Bulk API V1 Query - ResultId missing when running concurrent Bulk Jobs

When querying for the result ids of a batch on a closed Bulk (v1) query job, sometimes the result id is not returned; instead the full returned xml is: <result-list xmlns="http://www.force.com/...
1
vote
2answers
44 views

using SalesforceBulk API, batch_status() return 'state': 'Queued'

While searching the StackExchange for 'Queued' I found that most answers are related to apex code. In my case I'm using the SalesforceBulk API (through python). My scenario: When calling the ...
1
vote
1answer
123 views

Uploading multiple batches in Bulk API 2.0

I am currently using Bulk API 2.0 to insert, update and delete data in Salesforce. What I am confused about is uploading more than 1 batch of CSV records to a job before it is closed? I create a ...
4
votes
2answers
5k views

BulkAPI vs Dataloader?

I have never worked on handling large datasets and reading through the documentation raised the below questions in my mind: 1) If I need to load 10,000,000 (10 million) records into salesforce, Can I ...
2
votes
0answers
63 views

Bulk data load jobs missing batches and stuck in Open state

I am having a problem with Bulk Data Load Jobs where they seem to be submitted without Batches and as such appear to get stuck in Open state until they are manually Aborted. This is similar to a ...
5
votes
2answers
164 views

Transformation Spec limitation in Bulk API v1.0

We're using Transformation Spec feature of the bulk api when uploading records: https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/asynch_api_mapping.htm This allows us to ...
1
vote
0answers
34 views

Bulk Job Status - Failed vs Not Processed?

What are the use cases for setting a Bulk (version 1) job to a status of Failed vs Not Processed? Salesforce documentation gives the same description for both The batch failed to process the full ...
1
vote
2answers
133 views

Populating Big Objects from CSV

I need to create a client application where users can upload CSV files, which will then be used to populate Custom Big Objects. My problem is I'm not sure which API to use. The Salesforce ...
2
votes
2answers
428 views

How can I monitor the bulk API limit?

Salesforce limits you to 10,000 batches per 24-hour period. For reference: https://developer.salesforce.com/docs/atlas.en-us.salesforce_app_limits_cheatsheet.meta/salesforce_app_limits_cheatsheet/...
1
vote
1answer
102 views

How to enable Bulk API v2.0

We are loading data into Salesforce from Informatica and have enabled Bulk API option. But in the Salesforce Batch status pages, we see that v1 of the Bulk API is being used. We are using 41.0 ...
2
votes
1answer
407 views

Bulk API 1.0 - use Workbench

How can I use Bulk API 1.0 (for query) with Salesforce Workbench (or Postman) ? I found that doc explaining Bulk API 1.0 but only with cURL, and I'd like to use Workbench or Postman if possible, but ...