# Celigo imports endpoint - Pagination Options for Large Datasets

**URL:** <https://connective.celigo.com/t/celigo-imports-endpoint-pagination-options-for-large-datasets/68>\
**Category:** Integrator.io\
**Tags:** pagination, query-parameters, import\
**Created:** [July 29, 2024, 11:57pm UTC](https://connective.celigo.com/t/celigo-imports-endpoint-pagination-options-for-large-datasets/68 "2024-07-29T23:57:46Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![nuriensing](https://sea1.discourse-cdn.com/flex001/user_avatar/connective.celigo.com/nuriensing/32/6918_2.png) [@nuriensing](https://connective.celigo.com/u/nuriensing)\
**Post date:** [July 29, 2024, 11:57pm UTC](https://connective.celigo.com/t/celigo-imports-endpoint-pagination-options-for-large-datasets/68/1 "2024-07-29T23:57:46Z")

</div>

Hi,  
  
I'm working with the integrator.io API, specifically the [https://api.integrator.io/v1/imports](https://api.integrator.io/v1/imports) endpoint, to fetch all imports for our client. However, I'm running into an issue when dealing with a large number of imports.

**Current Situation:**

- I'm using Postman Flows to fetch and process the data from the /v1/imports endpoint.
- When there are many imports, the response array is too large for Postman **scripting** to handle efficiently, resulting in out of memory errors.

My Question: Is there a way to retrieve this data in smaller chunks or use pagination with the /v1/imports endpoint? Specifically, I'm looking for options like:

- Using query parameters such as 'limit' and 'skip' to paginate through the results. For example:

```
GET https://api.integrator.io/v1/imports?limit=100&skip=0
GET https://api.integrator.io/v1/imports?limit=100&skip=100
```

and so on. Or are there maybe any other sorts of pagination that I can use?

Thank you in advance.

---

<div class="post-metadata">

**Author:** ![nuriensing](https://sea1.discourse-cdn.com/flex001/user_avatar/connective.celigo.com/nuriensing/32/6918_2.png) [@nuriensing](https://connective.celigo.com/u/nuriensing)\
**Post date:** [July 30, 2024, 11:23am UTC](https://connective.celigo.com/t/celigo-imports-endpoint-pagination-options-for-large-datasets/68/2 "2024-07-30T11:23:16Z")

</div>

I also found out that the

```
https://api.integrator.io/v1/imports
```

does not return all imports but only a maximum of 1000.  
  
Is there a way to retrieve all imports via the API as well ?

---

<div class="post-metadata">

**Author:** ![tylerlamparter](https://sea1.discourse-cdn.com/flex001/user_avatar/connective.celigo.com/tylerlamparter/32/9204_2.png) [@tylerlamparter](https://connective.celigo.com/u/tylerlamparter)\
**Post date:** [July 30, 2024, 7:45pm UTC](https://connective.celigo.com/t/celigo-imports-endpoint-pagination-options-for-large-datasets/68/3 "2024-07-30T19:45:10Z")

</div>

@nuriensing for the question in your comment, you can retrieve more than 1000 by using the next page link in the response header. See article here: [https://docs.celigo.com/hc/en-us/articles/19141347828763-Manage-pagination-in-a-REST-API-call.](https://docs.celigo.com/hc/en-us/articles/19141347828763-Manage-pagination-in-a-REST-API-call.%C2%A0)

I'm not sure on the first question, but am checking.

---

<div class="post-metadata">

**Author:** ![tylerlamparter](https://sea1.discourse-cdn.com/flex001/user_avatar/connective.celigo.com/tylerlamparter/32/9204_2.png) [@tylerlamparter](https://connective.celigo.com/u/tylerlamparter)\
**Post date:** [August 1, 2024, 4:06am UTC](https://connective.celigo.com/t/celigo-imports-endpoint-pagination-options-for-large-datasets/68/4 "2024-08-01T04:06:22Z")

</div>

@nuriensing I confirmed this api currently doesn't support any type of limit parameter.

---

<div class="post-metadata">

**Author:** ![nuriensing](https://sea1.discourse-cdn.com/flex001/user_avatar/connective.celigo.com/nuriensing/32/6918_2.png) [@nuriensing](https://connective.celigo.com/u/nuriensing)\
**Post date:** [August 9, 2024, 8:16am UTC](https://connective.celigo.com/t/celigo-imports-endpoint-pagination-options-for-large-datasets/68/5 "2024-08-09T08:16:57Z")

</div>

Thanks @tylerlamparter