WSO2DAS中的分析

Question

I'm getting a Table Not Found error while running a select query on spark console of wso2das. I've kept all the default configurations intact after the installation. I'm unable to fetch the data from the event stream even when it's been shown under table dropdown of data explorer.

Answer 1

Initially when the data is moved into the wso2das, it would be persisted in the data store you mention.

But, these are not the tables that are created in spark. You need to write a spark query to create a temporary table in spark which would reference the table you have persisted.

For example,

If your stream is,

{
  "name": "sample",
  "version": "1.0.0",
  "nickName": "",
  "description": "",
  "payloadData": [
    {
      "name": "ID",
      "type": "INT"
    },
    {
      "name": "NAME",
      "type": "STRING"
    }
  ]
}

you need to write the following spark query in the spark console,

CREATE TEMPORARY TABLE sample_temp USING CarbonAnalytics OPTIONS (tableName "sample", schema "ID INT, NAME STRING");

after executing the above script,try the following,

select * from sample_temp;

This should fetch the data you have pushed into WSO2DAS.

Happy learning!! :)