🚀
Introducing Versions: Develop data products using Git. Join the waitlist

Improved Support for Replacing or Appending Data

One of the foundational ideas of Tinybird Analytics is resiliency and consistency under high frequency or big data updates.
Javier Álvarez
Co-founder
Sep 3, 2019
 ・ 
  min read

One of the foundational ideas of Tinybird Analytics is resiliency and consistency under high frequency or big data updates. We understand data as something that evolves and changes over time, therefore our product must treat data like that: as something that is alive.

Whenever you build a data pipe in Tinybird Analytics, your transformation nodes will always remain connected to the Data Sources they use. As soon as those Data Sources change, all their related transformation nodes will be recalculated in real-time. No delays.

Also, we’ve taken care of implementing everything needed to ensure your APIs keep performing in real-time as new data gets ingested. You will not need to worry about how and when you should be updating your data.

Although our API already supported appending data to an existing Data Source or replacing it entirely, during the last week we’ve added support for both replacing and appending data in our User Interface.

Append or replace data to an existing Data Source
Append or replace data to an existing Data Source

As you can see in the gif above, whenever Tinybird Analytics detects you are trying to import a Data Source with a name that already exists in your account, the advanced data import options are shown.

In case you need to append data to an existing Data Source directly, we’ve enabled a shortcut to do exactly that; you can find it in the Data Source modal window, as you can see in the image below.

Append data to a Data Source
Append data to a Data Source

Take a look at our documentation and let us know what you think, or sign up for early access to Tinybird (we’re gradually opening up early access to companies and developers).