Is SQL a good language for data transformations?
Is SQL a good language for data transformations?
I always wish I wouldn't have to pull in python/pandas to do simple data transformations on smaller local datasets/csv files and stick with sqlite. But then I tend to quickly hit a problem that seems to require dynamic SQL. Anything in between SQL and a general programming language that is made for transforming tabular data?
2 comments
tsql and plsql allow more flexibility than plain sql and are integrated in most modern platforms like postgre
honestly once you're familiar enough with sql you can do whatever you need to do via a series of tables, but most people aren't that skilled
typical enterprise tool would be informatica