Iaroslav (@izeigerman) 's Twitter Profile
Iaroslav

@izeigerman

Co-Founder of Tobiko Data

ID: 940203766770434048

linkhttps://github.com/TobikoData/sqlmesh calendar_today11-12-2017 12:57:00

182 Tweet

109 Followers

47 Following

Toby Mao (@captaintobs) 's Twitter Profile Photo

I love how DevOps enables software engineers to safely ship code faster. As a data engineer, I think we deserve something similar: the DataOps revolution. Here’s a 🧵 on why I made SQLMesh, an open source DataOps framework, which launches today github.com/TobikoData/sql…

Iaroslav (@izeigerman) 's Twitter Profile Photo

The next big thing in #data transformation space is here. Check this out to see why you should run your #dbt project with SQLMesh today.

Toby Mao (@captaintobs) 's Twitter Profile Photo

Yesterday, dbt announced contracts and versions. They're just additional YAML syntax further contributing to the pile of spaghetti code/configs. It puts even more burden on the end user without solving the underlying problems. tobikodata.com/the-false-prom…

Iaroslav (@izeigerman) 's Twitter Profile Photo

My new post on categorizing changes in #SQL queries is out! This is one of the key components for how we achieve automatic #data contracts in SQLMesh.

Toby Mao (@captaintobs) 's Twitter Profile Photo

I wrote a post hoping to demystify incremental loads for data pipelines. Even if you don't have Netflix's data scale, incremental loads can save you time and money! tobikodata.com/correctly-load… #dataengineering #sql

Toby Mao (@captaintobs) 's Twitter Profile Photo

SQLMesh v0.8.0 just dropped! Some exciting new features like docs which is integrated inside the IDE! We've also launched our Github CI / CD bot! sqlmesh.readthedocs.io/en/stable/inte…

SQLMesh v0.8.0 just dropped! Some exciting new features like docs which is integrated inside the IDE!

We've also launched our Github CI / CD bot!

sqlmesh.readthedocs.io/en/stable/inte…
Toby Mao (@captaintobs) 's Twitter Profile Photo

We spend so much time writing #SQL. Why don't our tools understand SQL? When you parse SQL you unlock: - Column Level Lineage - Automatic dependencies (no more {{ ref() }}) - Transpilation Check out this great post by Iaroslav tobikodata.com/semantic-under…

Toby Mao (@captaintobs) 's Twitter Profile Photo

As the usage of dbt grows, the cracks in its architecture become more apparent. You can either have simplicity or efficiency... but why should you have to choose? Check out this amazing blog post by Iaroslav detailing the costs associated with dbt. tobikodata.com/simplicity-or-…

Iaroslav (@izeigerman) 's Twitter Profile Photo

I’ve just accidentally glanced at my wife’s feed and realized that ads that show up in our feeds are probably the most revealing thing about us.

Toby Mao (@captaintobs) 's Twitter Profile Photo

Although companies heavily rely on SQL / data pipelines to power applications and make decisions, testing is usually an afterthought. However, systematic testing of data is critical to creating trustworthy and reliable pipelines. tobikodata.com/we-need-even-g…

Toby Mao (@captaintobs) 's Twitter Profile Photo

Are you using dbt and have heard of SQLMesh but aren't quite sure what it is? You are in luck, because this article is for you! We will teach you the basics of SQLMesh from a dbt user's perspective to help get you up to speed. tobikodata.com/sqlmesh_for_db…

Matthäus Krzykowski (@matthausk) 's Twitter Profile Photo

Alex Butler, senior data engineer at SF-based software delivery company Michael Harness, chose dltHub + SQLMesh to build an end to end data platform 💪 Learn more about his developer journey as he continues to build out the platform & its benefits to Harness dlthub.com/success-storie…

Toby Mao (@captaintobs) 's Twitter Profile Photo

SQLMesh v0.28.0 supports MSSQL (Microsoft SQL Server). Even better, it was contributed by a community member Dan! I'm so excited to see SQLMesh grow and gain traction! github.com/TobikoData/sql… sqlmesh.readthedocs.io/en/stable/inte… #dataengineering

Toby Mao (@captaintobs) 's Twitter Profile Photo

Unlike dbt, SQLMesh was designed to work efficiently with extremely large scales of data. Stop hemorrhaging money and stop wasting time manually managing big data sets! We've spent a lot of time on automated frameworks for working with massive data. tobikodata.com/evolving-large…

SQLMesh (@sqlmesh) 's Twitter Profile Photo

#SQLGlot and #SQLMesh are now implemented in Rust Language! 🤯 Jump on the bandwagon with us and parse #SQL 30-40% faster 😎 Check out Tobiko Data's latest #blog for the details. #Rust #data #transform tobikodata.com/sqlglot-jumps-…

#SQLGlot and #SQLMesh are now implemented in <a href="/rustlang/">Rust Language</a>! 🤯

Jump on the bandwagon with us and parse #SQL 30-40% faster 😎

Check out <a href="/TobikoData/">Tobiko Data</a>'s latest #blog for the details. 

#Rust #data #transform

tobikodata.com/sqlglot-jumps-…
Toby Mao (@captaintobs) 's Twitter Profile Photo

Today dbt announced column level lineage... but it's not open source and only available for paying cloud users. dbt is using SQLGlot (an open source SQL framework that my company Tobiko Data maintains) to power this newly gated feature. SQLGlot's lineage wouldn't exist without