Hi guys!
I ran into a problem while fetching the schema of a Spark table in SQL Runner. As I can see, Looker is using the following SQL command for this.
DESCRIBE <db>.<table>
And this command produces a result in this manner:
| col_name | data_type | comment |
|---|---|---|
| my_string_column | string | |
| my_date_column | date | |
| my_int_column | bigint | |
| # Partitioning | ||
| Part 0 | ||
| my_partition_key | string |
Which results in appearing of dummy columns in the parsed schema
Does anybody know any workarounds in such case?