When working with CSV[H] files in Drill 1.15.0+ everything comes back
VARCHAR
since that's the way it should be. The old behaviour of
sergeant
to auto-type convert was kinda horribad wrong. However,
it's a royal pain to make CTAS
queries from a giant list of VARCHAR
field by hand. So, this is a
helper function to do that, inspired by David Severski.
ctas_profile(x, new_table_name = "CHANGE____ME")
x | a |
---|---|
new_table_name | a new Drill data source spec (e.g. |
WIP!
if (FALSE) { db <- src_drill("localhost") # Test with bare data source flt1 <- tbl(db, "dfs.d.`/flights.csvh`") cat(ctas_profile(flt1)) # Test with SELECT flt2 <- tbl(db, sql("SELECT `year`, tailnum, time_hour FROM dfs.d.`/flights.csvh`")) cat(ctas_profile(flt2, "dfs.d.`flights.parquet`")) }