AI Columns
Last updated
Was this helpful?
Last updated
Was this helpful?
AI Columns enable you to dynamically generate unique content for each row in your dataset using LLMs like ChatGPT (OpenAI), Claude (Anthropic) and Gemini (Google). With AI Columns, you can define a prompt and use to reference values from other columns. This setup allows you to send a customized prompt request for each row, with the response automatically written back to your AI Column. The AI Columns materialize in your warehouse as well.
Automatically generate personalized email content or messages based on customer data.
Generate insights or recommendations from transactional data, such as suggesting complementary products based on purchase history.
Sentiment analysis of email received by sales team from outbound campaign to help with categorization and reporting
Summarize product usage among specific features by “high” or “low” to identify upsell fits and run PLG playbooks
Clean up data by removing special characters from a column
Dataset should have a Unique ID column
Step 2: Navigate to the Datasets tab by clicking on Datasets in the left navigation panel.
Step 3: Choose a dataset where you want to add a new AI-based column. Make sure the Dataset has a Unique ID column assigned
Step 4: Select Enrich & Enhance on your top right corner, choose AI and your preferred LLM provider.
Step 6: Create a prompt and fill out the column name.
Model Type - you can select from the provided list of models for the selected LLM provider.
The expected output type - there are several optional properties to help you guarantee data quality.
Step 7: Hit the Create button and that's it. Census will generate a AI based column into your dataset.
This step can take several minutes. Behind the scene, Census sets up OpenAI/Anthropic/Google as a destination and runs a sync across all your rows in the selected dataset.
The AI columns refresh every 6 hours and only process new rows.
The results generated by AI Columns are stored directly in your source warehouse. Census creates a new table within the Census schema, prefixed with DATASET_COLUMN_, containing the AI Column.
This allows you to not only sync these AI-generated columns to your destination via Census but also explore them further within your warehouse.
AI Columns are currently supported on Snowflake, Redshift, BigQuery, Databricks, and Postgres with more warehouses coming soon.
For more information, please see the rate limit policies for your specific LLM provider.
Census only sends your prompt to the LLM provider. If your prompt includes specific dataset columns via liquid templates, these columns will be included as part of the prompt sent to the LLM provider. No other data is shared with the LLM.
All requests made to the LLM provider are made through secure HTTPS channels, and only successful responses are saved to your dataset.
Checkout our for more examples and sample prompts.
Note : You will need your API key to connect a LLM Provider (OpenAI, Claude, Gemini) once you run out of Census .
To create a new OpenAI API key, log into OpenAI and navigate to and generate a new Project API Key.
To create a new Anthropic API Key, navigate to > Settings > API Keys and generate a new Key.
If you are a video person, watch . Otherwise, follow the steps below.
Step 1: your Census account.
Step 5: Skip this step if you have trial . Connect to selected platform (OpenAI, Anthropic, Google) using your API Key and click Next.
Refer to our for some inspiration!
The prompt to run against each row of your data. Your prompt can leverage to reference column values.
Data sent via Census to the LLM provider is not used for training models. For , please refer each LLM provider's data usage policies.
