Skip to content
How to retrieve 100...
 
Notifications
Clear all

How to retrieve 1000+ records from Airtable and upload as a CSV to Google Drive

3 Posts
2 Users
0 Reactions
6 Views
Sean_W
(@sean_w)
Posts: 2
New Member
Topic starter
 

I have an Airtable table with over 1000 records. My goal is to retrieve ALL records from a specific view whenever any record in the table is updated, then convert that data into CSV format, and finally upload the CSV to a designated Google Drive folder.

I attempted to set up a scenario using Airtable Watch Records followed by Google Drive.

In the Watch Records tool, I configured it to return 10 records. For the Google Drive upload, I specified the file name as MapMakeDataTest.csv in the “File Name” field. Within the Google Drive “Data” field, I mapped only the specific Airtable fields I wanted to save.

Upon running the scenario, only one record was returned. This record was saved to Google Drive as a CSV, but it contained only two fields:

  1. An Airtable field named Accession, concatenated with the recordID field from Airtable (this field was not among those I mapped in the Google Drive tool).
  2. A single, lengthy field containing all the data from the other mapped fields.

I considered that I might need to include commas between the fields in the mapping (as shown in the image). However, this approach resulted in a blank CSV file.

Could someone please assist me in troubleshooting this scenario?

I would appreciate any help in resolving this.

 
Posted : 30/03/2024 12:04 am
samliew
(@samliew)
Posts: 293
Reputable Member
 

Welcome to the callin.io community!

1. Screenshots of module fields and filters

Please share screenshots of the relevant module fields and filters in question. It would greatly assist other community members in understanding your situation.

You can upload images here using the Upload icon in the text editor:

Screenshot_2023-10-07_111039

2. Scenario blueprint

Please export the scenario blueprint file to enable others to review the mappings and settings. You can find the Export Blueprint menu item at the bottom of the scenario editor by clicking on the three dots.

Screenshot_2023-08-24_230826

3. And most importantly, Input/Output bundles

Please provide the input and output bundles for the modules by running the scenario (or retrieve them from the scenario History tab). Then, click the white speech bubble on the top-right of each module and select “Download input/output bundles”.

Screenshot_2023-10-06_141025

Providing the input/output bundles will enable others to replicate the scenario's behavior, even if they don't use the external service.

Following these steps will help others assist you. Thanks!

 
Posted : 30/03/2024 2:25 pm
Sean_W
(@sean_w)
Posts: 2
New Member
Topic starter
 

Thank you for your assistance. Please find the requested files attached.

Kindly note that the Airtable input bundle was empty. The Google Drive output bundle is not included as it contained personal details from my Google account.

Airtable output bundle:

[
    {
        "Accession Year": 2023,
        "Taxon Name": [
            "recSjOHX6Nx9eMFoi"
        ],
        "Latitude": 33.38908997,
        "Longitude": -111.8729646,
        "Campus Section": [
            "receSbcdONlsvehnw"
        ],
        "Item Status": "Planted",
        "Photo": [
            {
                "id": "attrgoq9qvRS7Hkha",
                "width": 3024,
                "height": 4032,
                "url": "https://v5.airtableusercontent.com/v3/u/27/27/1711764000000/xX317ivHq0M29p6IVNiDEQ/mOuuUc59DkkzMxHlP7LaJHPKI2tnIivAdjuTvElkQ-z3YWwhr0yWEkk8ESdL3pFIMBvXoDI1jH41XwlHrhoz5lkbCEWCOYHNhtDIDibeltnsdyHlLcJkJrozxoMgi-X13D5vUUqXtl6aVabu3z-kJA/mo0koLzLNAQP3UJSWWMQJtZ7bHx62a_l-KEC7HFavF0",
                "filename": "bi2.jpg",
                "size": 9055921,
                "type": "image/jpeg",
                "thumbnails": {
                    "small": {
                        "url": "https://v5.airtableusercontent.com/v3/u/27/27/1711764000000/IjtS3WJDz67lCE6sYB7f9Q/rE6PDW15RPrBu-Ps1gRev3Bv9Op6hY20j49hqvhCzilkwVoCAKePxmegL7eGnbvEOXs-E2vSz3us8Z57af1KweFxSmihOegEbrrfxQJGr0eltv6D5nuN5DLVbHbRHZpNgYaPa5GIujVPu9kQGOntRw/efUQ07oo0kV334UH0aqUSCqG7a2ktzU5Xjft71feXMg",
                        "width": 27,
                        "height": 36
                    },
                    "large": {
                        "url": "https://v5.airtableusercontent.com/v3/u/27/27/1711764000000/HKDtDRTwDp2dkRh46yVlTQ/VM9xfOG8O1k66-GwvwluQJYaxbSi0tDT8BQroJix4UWShrNm70ZjzgjSwMr9P0wf_p6yqwG1aZG9LOTyRU0nt6iFIDluZrI0dgzspKx2YfaHfBmN2tFN-hlULcrM3rOC4zQQitJCovU0bL-1HQvgUA/HbUxxpqpRDzGyLAh2SsbpEzCkXYvJe73JTj085eXH5c",
                        "width": 512,
                        "height": 683
                    },
                    "full": {
                        "url": "https://v5.airtableusercontent.com/v3/u/27/27/1711764000000/ZL4y2CAMH4v3d3usdMuM-w/xmYOWgrFELka1KlzTS71uz92d0vSfjUDG5hx-gQjo0NFans_nFw6idjSqexU9Uid5cqRHTJhTrIVtMG9UE1TwButEcYiCJmozbUhfTWAgyMiBNBXpnUDGqv6x6canQYY7wtcSNGyLrO2bhnq8c-mXA/h9M3jsoYJ3R-zL-0ntnFX--hLDtxLgzDNuGMDQJUv88",
                        "width": 2250,
                        "height": 3000
                    }
                }
            }
        ],
        "Date Planted": "2023-11-17",
        "Provenance": "Arid Zone Trees",
        "Item Status": "Planted",
        "ID Tag": "Tag absent",
        "Autonumber": 1447,
        "Accession": "1447",
        "Family": [
            "Bignoniaceae (Trumpet vine family)"
        ],
        "Origin": [
            "Southwestern US, Mexico"
        ],
        "Common Name": [
            "Bi-Color desert willow"
        ],
        "Cultivar": [
            "'AZT Bi-Color'"
        ],
        "Species": [
            "linearis"
        ],
        "Genus": [
            "recGM81nWLJ4hoZpr"
        ],
        "Temp Attachment URL": "https://dl.airtable.com/.attachments/76604d97343ca47f4b3074eaf2220285/5a904ad2/bi2.jpg",
        "Status Updated": "2023-11-29",
        "LatLong": "33.38908997, -111.8729646",
        "Life Form": [
            "Tree"
        ],
        "Record ID": "recDT6RlujoxtYOs9",
        "Last Modified": "2024-03-29T22:44:39.000Z",
        "Taxon Name Display": "Chilopsis linearis 'AZT Bi-Color'",
        "Arizona Native": [
            "Native 🌵"
        ],
        "View on Map": {
            "label": "View on map",
            "url": "https://mesacc.maps.arcgis.com/apps/webappviewer/index.html?id=bff97ca947f9484881e2e13b936b26e9&query=186d7d1beeb-layer-18%2CAccession%2C1447"
        },
        "Photo File Name": "bi2.jpg ",
        "Photo Last Modified": "2023-11-29",
        "Created": "2023-11-29T22:24:20.000Z",
        "Attachment URL": "https://media.aeropage.io/api/imgcache/token/9b2a984b7ad1f3eee8d719300b9cb751/recDT6RlujoxtYOs9",
        "Date Measured": "2024-03-27",
        "id": "recDT6RlujoxtYOs9",
        "createdTime": "2023-11-29T22:24:20.000Z"
    }
]

Google Drive input bundle:

[
    {
        "data": "1447recSjOHX6Nx9eMFoirecGM81nWLJ4hoZprlinearis'AZT Bi-Color'Bi-Color desert willowSouthwestern US, MexicoNative 🌵Bignoniaceae (Trumpet vine family)33.38908997-111.8729646 https://media.aeropage.io/api/imgcache/token/9b2a984b7ad1f3eee8d719300b9cb751/recDT6RlujoxtYOs 9",
        "select": "value",
        "convert": false,
        "filename": "MakeMapDataTest.csv",
        "folderId": "/0B1EIvpt0SU1DU214S0d1UU5LQkE/1RLyZpRjg-0SFWxNMm5q9akqD0wKifehn/1nRFW0qVj83AqDLNcQIBw6MTE_txNq0Xh/1uXrO_rX2xFqxP77LpdRCgzVMSWuaY2E7",
        "destination": "drive"
    }
]

callin.io_blueprint.json (46.6 KB)

 
Posted : 30/03/2024 9:14 pm
Share: