Skip to main content

hdhsource

Description​

Allows retrieving data from Hadoop Hive.

Note: To use the hdhsource source, an SM Hadoop Proxy connector must be configured.

Syntax​

hdhsource <db_name.table_name> [qsize=<int>]

Required Arguments​

  • db_name.table_name

Optional Arguments​

  • qsize — maximum number of records to retrieve

Source Configuration

All source configurations are stored in settings.yml.

sme:
  dbs:
    hadoop_hive:
      connector_url: 'http://localhost'
      connector_port: 18081
      hadoop_hive_connection_string: 'jdbc:hive2://127.0.0.1:10000'
      hadoop_hive_user: ''
      hadoop_hive_password: ''

Description of Configuration Parameters​

  • connector_url — URL of the SM Hadoop Proxy connector
  • connector_port — port for the SM Hadoop Proxy connector
  • hadoop_hive_connection_string — connection string for Hadoop Hive
  • hadoop_hive_user — Hadoop Hive user
  • hadoop_hive_password — Hadoop Hive user password

Example Queries​

Example 1:

hdhsource 'hr.employee_list'
| search status="Terminated"
| fields user_name

Example 2:

hdhsource accessLogs
| search [ hdhsource 'hr.employee_list' | search status="Terminated" | fields user_name | format ]