404 on select * from table but not describe table

[dah33]

This is on Databricks build 6.1 (includes Apache Spark 2.4.4, Scala 2.11):

CREATE TABLE tmp_weekly
USING com.github.potix2.spark.google.spreadsheets
OPTIONS (
    path "sheet_identifier/Weekly",
    serviceAccountId "[email protected]",
    credentialPath "/dbfs/FileStore/credentials/blah.p12"
)

The CREATE is fine, as is:

> describe tmp_weekly
col_name	data_type	comment
my_col1	string	null
my_col2	string	null

But select fails:

> select * from tmp_weekly limit 1

Error in SQL statement: GoogleJsonResponseException: 404 Not Found
{
  "code" : 404,
  "errors" : [ {
    "domain" : "global",
    "message" : "Requested entity was not found.",
    "reason" : "notFound"
  } ],
  "message" : "Requested entity was not found.",
  "status" : "NOT_FOUND"
}

I have installed com.github.potix2:spark-google-spreadsheets_2.11:0.6.2 via Maven.

Update: I reproduced on 0.6.3.

[tadas-subonis]

@dah33 Have you figured out how to solve this one? I am facing the same problem

[dah33]

Unfortunately not, and I'm no longer working for that client.

[LucaXD-china]

My way is to use CREATE TEMPORARY VIEW to get data and write to another normal hive table.