BigQuery

Capabilities#

Adding the BigQuery integration to HumanFirst Studio will let you import data directly from BigQuery.

Adding a BigQuery integration#

For these steps, you'll need to have administrative privileges on your namespace.

  1. Navigate to the "Integrations" section
  2. Click "Add integration"
  3. Choose the "BigQuery" integration

Complete the BigQuery integration form#

  1. Name your integration
  2. Project id, obtained from BigQuery
  3. Upload your GCP JSON key, obtained from BigQuery (see below for process)

You're now ready to import data from BigQuery.

Importing data from BigQuery#

HumanFirst supports two types of data sets:

  • User upload data sets: these contain user uploaded files containing the utterances to be used in HumanFirst.
  • Integration data sets: these are linked to an integration and contain the imported data from that integration only.

It is not possible to mix different types of data sets together.

Creating a BigQuery data set#

  1. Navigate to the data management section
  2. Create a new data set.

  1. Add data to the new data set.

  1. Choose the "From an integration option"

  1. Choose BigQuery

  1. Provide a valid SQL query to fetch the data from BigQuery.

  1. Map the BigQuery output as needed. BigQuery data is imported similarly to a CSV file. You will need to specify which columns represent which information for your data to work properly in HumanFirst.

You are now ready to link this data set to any workspace you have in HumanFirst.

Google Cloud Console steps#

Select your GCP project#

  1. Go to https://console.cloud.google.com/
  2. Select the project in which you want to enable Vertex AI
  3. Note your GCP project ID

Create a service account#

  1. Go to the Google Cloud Console IAM / Admin section
  2. Go to the service accounts section
  3. Click create a service account

Add the corresponding roles#

Fill out the form, make sure to provide the following roles: BigQuery Data Viewer, BigQuery Job User, and Service Usage Consumer roles. Add any team members who will need to administer the JSON keys.

note

Access Control BigQuery Data Viewer when applied to a table or view, provides permissions to: read data, and metadata from the table or view. BigQuery Job User provides permissions to run jobs, including queries, within the project. Service Usage Consumer is recommended and has the ability to inspect service states and operations, and consume quota and billing for a consumer project. Read more about each role here.

Create a JSON key#

  1. Navigate to the service account
  2. Open the "Keys" tab
  3. Create a JSON key.
  4. Follow steps above to add key as HumanFirst integration