Questions tagged [bulk-api]

Bulk API is based on REST principles and is optimized for loading or deleting large sets of data. You can use it to query, insert, update, upsert, or delete a large number of records asynchronously by submitting batches which are processed in the background by Salesforce.

Filter by
Sorted by
Tagged with
0
votes
0answers
17 views

Bulk API 2.0 sf_Error CaseTriggerMaster: System.LimitException: Apex CPU time limit exceeded:

I am trying to run an update operation on Case object using Bulk API 2.0. I am using Python with requests package to send the API calls. I am able to get through the whole process of creating a job, ...
0
votes
0answers
15 views

How are api limits calculated for data export using data loader tool?

I want to export a million records into csvs using data loader, but as precautionary step I would like to know how the api limits would be calculated to export these million records?
0
votes
1answer
28 views

Usage of salesforce bulk api for integration with java using rest

I am new to salesforce, hence this long post. I wanted to create a java app to do CRUD on salesforce. I have followed the rest api tutorial, and created app for fetching data from salesforce using ...
0
votes
1answer
26 views

Bulk API upsert error for a Field type Location

I'm using the Bulk API v2 for upserting data into a CustomObject. When i try to upsert data without the CustomField Location, it works correctly, but when i add in the CSV the Location__c header, i'm ...
1
vote
1answer
26 views

Salesforce Postman create job post in xml but not in json

I'm following this example to create a job using json: InvalidUrl Bulk API creating a bulk job using postman I've been successful to use the request body as xml instead of json, but I desire it to be ...
0
votes
0answers
15 views

transform records from jsforce bulk api query

I am trying to modify the results of a query that uses the bulk api by using the recordStream.on('record',...) function. I've stepped through the code but it making modifications here (or in other ...
0
votes
1answer
16 views

Using C#, how can I get a jobId for Bulk Api 2.0?

I am trying to set data from an Azure Service Bus to an instance of Salesforce using the Bulk API 2.0 and and REST (because who really wants to deal with SOAP?). I am currently struggling "simply&...
0
votes
0answers
26 views

Using the Bulk API, can I create both Custom Objects and their parent Person Accounts concurrently? [duplicate]

Our org uses Person Accounts. Each Person Account will be a parent record for at least on Bank_Detail__c record. We have an externally hosted website which will collect information about our pending ...
0
votes
0answers
27 views

REST API BULK 2.0 JOB LIMIT

Regarding Bulk 2.0 API, It was mentioned in the Salesforce doc "https://developer.salesforce.com/docs/atlas.en-us.api_bulk_v2.meta/api_bulk_v2/introduction_bulk_api_2.htm" that the batch ...
0
votes
0answers
31 views

Bulk API v2 Failed because of wrong Data type

We are uploading vast amount of Data using the Bulk API v2 of Salesforce. Some of our data do not match the valid data type of our fields in Salesforce resulting in a fail import of our data . For ...
1
vote
0answers
26 views

The best practice of download objects with millions of records [duplicate]

We are looking for a scalable & performant way to download Salesforce Objects which can support objects with tens of millions records. I have two approaches in mind: Use Bulk Query API 2.0: It's ...
0
votes
1answer
23 views

Data Migration - Replication vs Bulk API

I'm curious to understand the pros and cons of the Replication API and the Bulk API When migrating 20 objects with approximately 75MM rows, which would you choose? Why? Which would be fastest? Why?
0
votes
0answers
20 views

Bulk updates performed via the Bulk API not streamed via the Streaming API?

Our Salesforce integration uses their Streaming API to process Salesforce updates from our clients in near real-time. However, we've recently received a couple of support tickets claiming our data was ...
0
votes
1answer
32 views

Bulk search all objects from csv

Is there anyway to run a bulk search in my instance looking to match one column (email address) from a csv? I get some long files that need mass checks for compliance reasons (400 rows - match on one ...
0
votes
1answer
45 views

Salesforce SSL Cert imported into java trust store for integration works on the day imported but gives certificate error the next day

I am importing the Salesforce SSL certs for the test.salesforce.com and our sandbox environment using the commands below in a VM server environment. Import test.salesforce.com or login.salesforce.com ...
3
votes
1answer
28 views

Can There be Multiple Result IDs for a Query Operation Result?

When retrieving the result of a batch of a query bulk job, according to the documentation, the following is returned. <result-list xmlns="http://www.force.com/2009/06/asyncapi/dataload"> <...
0
votes
0answers
67 views

Find/Replace JSON Keys with Apex

I'm stuck preparing a JSON body for a request. I am pretty new to JSON and don’t fully understand the parsing class syntax, but I conceptually understand what I’m trying to do. Overall Goal: My ...
0
votes
1answer
24 views

Is ActivityDate a known bug with bulk API loading tasks?

I've been fighting Salesforce all morning with a data load via the Python simple_salesforce package (so yes, the bug could be there, rather than there being an issue in the Bulk API). If I run this ...
0
votes
1answer
31 views

Bulk API upsert with both External Id and SFID in JSON

I'm using the Bulk API to upsert records into Salesforce. The Request contains both an External ID and also a Salesforce Id. Even though in the job detail references using the external Id, will ...
1
vote
0answers
22 views

Bulk Query with PK Chunking via WSC — error reading extracted records with CSVReader

I'm having an issue with the CSVReader class in the Salesforce WSC. The error I get when trying to read the contents of a batch is "com.sforce.async.CSVReader$CSVParseException: Found unescaped quote. ...
3
votes
1answer
95 views

Is it impossible to export more than 2000 records from an aggregate SOQL query?

It seems odd to me that this would be simply impossible to do, but the aggregate query below returns more than 2000 records, and it appears that there is no possible way to even run the query, let ...
0
votes
1answer
42 views

Create Account and Contact at the same time with Bulk API

I'd like to create an account and then a contact in the same call using bulk api. I've used composite api calls to create an account and contact in the same API request. I would now like to do the ...
0
votes
2answers
77 views

Is it possible to change the size of the Auto-Chunked Batches in bulk API

We are implementing a Bulk API V2 client in order to insert hundreds of thousands of records. Our current implementation is the following : first we create a job we add a batch containing all the ...
0
votes
1answer
50 views

Workbench: Bulk API to delete 1M records

I am looking for an official resource or step-by-step instructions to use Bulk API to delete more than a Million of records from a custom object. I couldn't find a proper documentation online and ...
0
votes
0answers
30 views

Salesforce BULK 2 unsorted result of CSV query

I want to ask regarding BULK API 2.0 Query/data downloading through workbench and postman. Scenario I am downloading salesforce data in form of CSV. Query i am executing is "SELECT Id,Name,...
4
votes
2answers
57 views

Execution order of multiple Duplicates rules on an Object

I have two active duplicate rules on Account object. Is there a particular order in which they are executed? or is it random? If a record is marked as "duplicated" by a Duplicate Rule, this record ...
0
votes
0answers
21 views

Close Salesforce Job Not working via Bulk API

One of my sandboxes was recently upgraded with some security patches and now I have noticed I am unable to close jobs via the Salesforce Bulk API. I am doing a patch on /services/data/v43.0/jobs/...
0
votes
0answers
37 views

Bulk API 2.0 …/jobs/query returns NOT_FOUND

I'm trying to use the bulk API 2.0 to query data in a partial sandbox instance. The query posts just fine, but when I try to obtain metadata on all queries using .../services/data/v47.0/jobs/query ...
0
votes
1answer
61 views

Bulk API fails to insert w/ null RecordTypeId, but Rest API succeeds

I've come across an error where the Bulk API and the Rest API differ in their behavior when inserting records with record types. To sum up the problem: Suppose one or more custom record types are ...
0
votes
0answers
41 views

Error 'Java Heap Space' in Data Loader

With Data Loader (Version 44.0.0),I am trying to insert Attachments in Salesforce. There are 12k PDF files. Each file is around 190 kb. So total attachment are 2.28 GB This is the structure of my ...
0
votes
1answer
40 views

Importing 40k PDF as attchments

I have 40k PDF's in windows shared drive. Each pdf should be attached to parent account. The name of each pdf is an external ID in salesforce. e.g AA123.pdf corresponds to AccountRecordId '...
2
votes
1answer
145 views

Bulk API vs Bulk API 2.0 Query Length

We've been using the BulkAPI (XML/SOAP) successfully for several months now and were looking to migrate over to the BulkAPI v2.0. However, when submitting a job (queryAll) to the 2.0 API we're ...
0
votes
1answer
58 views

Bulk API library for Java

I searched on the internet for a bulk API library for Java, but I could not find anything relevant. Do you know any bulk API library for Java?
0
votes
1answer
29 views

how we know which version to pass in the bulk API

I am integrating the SF via connected APP and I'm trying to do bulk query and i followed the document and got to know how to achieve. My question is, how can i know which version should i pass in the ...
0
votes
1answer
63 views

Query “Bulk Data Load Jobs” IDs

Is there a way to use WorkBench/Apex/Rest-Explorer to query all "Bulk Data Load Jobs" IDs for last X days? Use Case - We want to set up some logs and monitoring on different users consuming our org ...
1
vote
1answer
38 views

WhoId, OwnerId and WhatId CSV Headers?

Polymorphic & Relationship Fields I'm trying to insert a task via Bulk API and providing the below csv headers, but getting Malformed_ID error. Owner:User.FederationIdentifier Contact:Who.Id ...
0
votes
1answer
252 views

how to query job batches info bulk api 2.0

Before, using bulk api 1.0 endpoint. I could make request to get all job's batches like so: ` req.setEndpoint('callout:BulkApi' + '/' + jobId + '/batch'); req.setMethod('GET'); req.setHeader('...
2
votes
0answers
54 views

REST API Calls Consumption in Marketing Cloud [duplicate]

If 1 million records are pushed into a data extension via REST API, does this count as 1 call or would it consume many calls?
0
votes
1answer
212 views

Does bulk api 2.0 support deletion of data?

Salesforce documentation is contradictory. In documentation of Bulk API 1.0 it is mentioned that Use Bulk API 2.0 instead of Bulk API if you want a simplified process for inserting, updating, ...
2
votes
0answers
212 views

Is there a way to delete >1 Million records from a custom Big Object?

First thing that came to my mind was writing a Batch Apex to do this but I get this error. System.UnexpectedException: The requested operation is not supported by this SObject Deleting via Bulk API ...
0
votes
1answer
95 views

BULK API Status Not Found

A simple bulk API which I am trying to create a JOB, and I am getting the status "NOT FOUND" and code: 400. The same request working in the Workbench. Not sure what I am missing. bulkApiController....
0
votes
1answer
255 views

simple_salesforce - Cannot bulk insert more than 10 records at a time [closed]

I am using the simple_salesforce Python package. I tried bulk inserting 100 records using bulk.insert(), and did so without any errors. However, when I checked how many records were present after, ...
0
votes
1answer
30 views

Optimal Data Load Speeds

We are currently attempting to load a large amount of data, and are currently using the BulkAPI, with chunk size of 200 and batches of 2000. Is there documentation anywhere that would outline the ...
0
votes
1answer
55 views

Exporting of and capturing changes on a large set of records

We have to load the entire Salesforce Lead data(this data might be millions records)to external system using Bulk API. Once all the data loaded and we thought to initiated to catch the added/modified/...
0
votes
1answer
291 views

SalesForce Bulk API response to Pandas DataFrame [closed]

I'm a beginner with the Salesforce API and recently, I've been trying make bulk API requests and convert the response into a pandas DataFrame, however, the results I'm having a tough time with are ...
0
votes
1answer
123 views

Upsert using relationships

I have a custom object Relation__c which has two fields a__c and b__c both are lookups to the standard Account Object. The Account object has an external Id field called z__c If I have to use Bulk ...
1
vote
0answers
169 views

Salesforce Bulkv2.0 job failed with error message: Failure writing to File store

I executed a bulk job using the Salesforce Bulkv2 API. Operation: Upsert Status: Failed State Message: Failure writing to File store I can't find information on this error and am wondering what ...
2
votes
1answer
178 views

Will Bulk API be affected by System.isBatch()?

I have a trigger that needs to be run during a Bulk API insert/update of records but that needs to not run during an Batch Apex Job like: global class myBatchClass implements Database.Batchable<...
0
votes
0answers
373 views

Got “java.io.IOException: Premature EOF” error randomly when retrieve large data from Salesforce

When we use salesforce bulk query to retrieve data from salesforce module. There are more than 10 million records in the target module. we got this kind of error randomly: [FATAL]: local_project711....
1
vote
1answer
291 views

InvalidUrl Bulk API creating a bulk job using postman

URI i'm using is: https://yourInstance.salesforce.com/services/async/46.0/job so in my case example is https://cs89.salesforce.com/services/async/46.0/job but it still says InvalidUrl. X-Session-Id ...

1
2 3 4 5
7