Upload Guide

There are 3 different dataset viewers in Smartdata, the inspection viewer, the 2D viewer and the 3D viewer. All three viewers have a similar upload process. The only thing that differs between them are expected processing times. This is explained at the end of this document.

Prepare the Dataset

To start with, you need to prepare your raw dataset. For the purposes of this document, a “raw dataset” is a collection of image files that have been obtained directly off of your drone with no modifications. To prepare your dataset, follow the steps below:

  1. Every raw image from a dataset should be contained within one folder (ie no sub folders). If you have multiple datasets for a single site, these should be organised into separate folders for each dataset.

  2. Check that there are only image files in your organised folder. The upload tool will try to ignore files that aren’t images, but it’s good practice to only include compatible source files.

  3. Check your images meet our upload requirements as outlined below. If any of the mandatory requirements are not met, the upload or processing pipeline will fail. If any optional requirements are not met, you may get poor quality results.

Image Compatibility Requirements

We recommend using a DJI drone (with official DJI camera/lens attached) for all dataset capturing. After extensive field testing, we’ve found them to be the most reliable, and they meet all requirements outlined below.

Mandatory Requirements

Each item in this section is required to upload and process a dataset.

  1. Images have a minimum resolution of 640x480 pixels.

  2. Images were taken within a short timeframe, ie during the same flight where possible. For multiple flights, you should minimise the time between them.

  3. Image acquisition guidelines for each type of dataset are followed precisely.

  4. Each image contains the following metadata:

    1. “creation_date”

    2. “iso”

    3. “shutter_speed”

    4. “aperture”

    5. “focal_length”

    6. “width”

    7. “height”

    8. “lat”

    9. “lng”

    10. “alt”

    11. “relative_alt”

Optional Requirements

Each item in this section is strongly recommended to get good results.

  1. Images should contain consistent shadows and similar lighting between them.

  2. Image file contains the following metadata:

    1. “color_space”

    2. “flight_roll”

    3. “flight_yaw”

    4. “flight_pitch”

    5. “gimbal_roll”

    6. “gimbal_yaw”

    7. “gimbal_pitch”

Check Metadata

You can check what metadata your raw images contain by using a third party tool such as metapicz. We do not guarantee the accuracy or reliability of any third party tool.

Start the Upload Process

To start the upload process, navigate to the “Upload Dataset” link from the “Tools” dropdown menu. Follow the prompts on the screen to select or create a site, select or create a dataset, then choose images for uploading. Alternatively, you can watch the video tutorial below. We recommend clicking on the YouTube logo so you can open it in a new window and make it fullscreen.

Wait for Processing

At the moment, our processing times are a bit higher than we’d like. Every day we’re finding new ways to improve our pipeline and reduce processing times. Our aim is to get all timelines under 12 hours. Exact times vary and depend on our current queue of datasets and dataset sizes.

Here are our current expected timeframes:

2D Inspection Datasets: 24 hours from upload completion

2D Orthomosaic Datasets: 3 days from upload completion

3D Model Datasets: 3 days from upload completion

When a dataset has finished processing, you’ll get an email with a link to view it and it will show up in Smart View. If you’ve been waiting longer than our expected timelines above, please contact us for support and we’ll prioritise your request.