-
Notifications
You must be signed in to change notification settings - Fork 1
EVF Advanced Tutorial
Our first-cut implementation used a "late schema" approach: we created columns on the fly. However, the log reader actually knows the schema up-front; it is specified in the plugin configuration. We can exploit that fact to create a more robust implementation.
((Need code))
((TO DO))
The log format plugin was created prior to the EVF. As a result, the only way it could provide a schema was via the plugin configuration. Starting in 1.16, Drill provides a [schema provisioning](need link) mechanism so we can decouple our file schema from the plugin configuration: we don't have to define a new config for each new kind of file: we can associate the schema with the file.
((Need details))
The log format plugin normally defines the file regex in the plugin config. Continuing to build on the Drill 1.16 schema provisioning mechanism, we can instead associate the regex with the table.
((Need details))