Numidian Convert December 2019 Update

You might have noticed we changed names. No, we’re not changing owners, this is just a simple rebranding, read the announcement article if you want to know more.

We’ve also released some major updates this month, here’s the run down!

Preview your data before you convert

You can now preview how your data will look like before you export, this way you can play around with the schema until you’re happy with the result, and then download your export, instead of having to export, check your file tweak and do it agian.

This was specially frustrating when converting large files, as the conversion job can take a while.

We built two preview modes, first, the document viewer mode, which shows records in JSON format, which is useful when you’re converting files with nested objects or arrays.

The other mode is the table mode, best for flat record structures.

It also doesn’t matter how big your file is, showing a preview will take less than a second :)

Expand rows for fields

We do our best to autodetect the schema of your file and decide on the best way to flatten it, but some files are sometimes too complex for us to make the right decision for you, as you might want your data flattened another way.

That’s what the new Expand rows option in the field editor is for!

If we we’re converting some JSON data:

{"id":1,"name":"John","pets":["Spark", "Blue"]}
{"id":2,"name":"Mike","pets":["Flash", "Red"]}
{"id":3,"name":"Kate","pets":["Moosh"]}

By default, we won’t flatten the array, so when you export it to CSV, you’ll get something like this:

"id","name","pets"
1,"John",[\"Spark\"\,\"Blue\"]
2,"Mike",[\"Flash\"\,\"Red\"]
3,"Kate",[\"Moosh\"]

Which might not be what you want. But when you enable the Expand rows option on the pets column, you get the following CSV data:

"id","name","pets"
1,"John",Spark
1,"John",Blue
2,"Mike",Flash
2,"Mike",Red
3,"Kate",Moosh

As you can see, the pets column has expanded the array into multiple rows, which is much better suited for SQL or Excel.

Advanced export options

We used to have good defaults for exporting data in various formats, but some of you have asked for advanced options, so we’re adding support for various options when exporting in JSON, SQL or CSV.

For JSON, you’re now able to select the output mode:

  • Default: This mode outputs a non-formated JSON array
  • Newline delimited: This mode outputs JSON documents separated by a newline, this format is perfect when importing data into Google BigQuery or any big data processing software
  • Pretty: This mode outputs a pretty printed JSON array

For SQL, you can now select the SQL flavour, which affect how keywors and stirngs get formatted. You can also configure the table name.

For CSV, you can now choose whether you want to output the headers as the first row. You can also select the column delimiter and chose the empty value that will be used.

Export a file multiple times

You’re now able to export the same file you upload multiple times (no limit!), in case the result wasn’t what you expected, or the conversion failed.

You’ll see up to 3 export jobs above the new export form.