I would like to download a report generated in Salesforce every month as a csv file and process it on our side. I explored the analytic api which has a limit of 2000 rows per call, writing a soql query is a option but its cumbersome. Can I ftp the report to a location on our server once its generated in Salesforce? What would be the ideal way to download a report with 100k records?
You can use the apex Data Loader, there's a way to set it up using a batch file and Windows Task Scheduler. I set it up for a client, it's not actually too difficult to use :)
Check out these:
https://developer.salesforce.com/page/Using_Data_Loader_from_the_command_line https://help.salesforce.com/apex/HTViewHelpDoc?id=command_line_intro.htm&language=en_US https://help.salesforce.com/apex/HTViewHelpDoc?id=using_the_command_line_interface.htm