How to export/fetch million of records in bulk using API? | Community
Skip to main content
Answered

How to export/fetch million of records in bulk using API?

  • January 28, 2023
  • 1 reply
  • 83 views

Currently, I am working with a client have million of records(contact, conversation, team, admins etc and they want to export these records to a remote Database where they want to consume the data on their own way. So I am fetching the records using the API and it has a limit of max page size 150. If we want to export around 4.3M records then it will required around 28667 https calls and a huge amount of time.

So is there any way to increase the page size or fetch the records in bulk using the API ?

Best answer by Joseph S.

Hi @manish k​ 

 

As I can see in Intercom API documentation, the max response for the pagination may be 150 indeed. Not sure if you can go around it.

https://developers.intercom.com/intercom-api-reference/reference/pagination-cursor/p>

 

1 reply

Joseph S.
Expert User ✨
Forum|alt.badge.img+6
  • Expert User ✨
  • Answer
  • January 31, 2023

Hi @manish k​ 

 

As I can see in Intercom API documentation, the max response for the pagination may be 150 indeed. Not sure if you can go around it.

https://developers.intercom.com/intercom-api-reference/reference/pagination-cursor/p>