Data formatting and validation

Whether interacting with Lexer’s APIs, or simply sending data via SFTP or CSV upload, ensuring your data is well-formatted and validated is a sure-fire way to optimize your CDXP experience.

Addresses

Address data can vary greatly depending on the regions your data represents. We have a very open definition of what valid address data looks like to ensure all valid addresses can be used.

However, good address data can have a significant impact on your team’s use of the CDXP, particularly if your use cases include location-based segmentation and insights. It’s recommended that you consider how easy to use your address data is. For example, are your states in a consistent format? I.e, VIC versus Victoria; NY versus New York.

Depending on the configuration of your CDXP unification policies, customers’ address data might be used to unify against 1st, 2nd, or 3rd-party data. In doing so, geocoding services may be used to prepare data for unification. You may want to consider validating your address data using one of the many geocoding services, such as OpenStreet Map, to minimize issues with your customer data.

Currency and financial data

Currency and financial data is accepted as decimals without symbol suffixes or prefixes, i.e. “12.99”, “-100.00”.

Where a currency can be provided, it should be in an ISO-4217 format, i.e. “AUD” or “USD”. The case of the code does not matter.

For information on our currency conversion capabilities for multi-currency data, please contact us.

Dates

All dates and timestamps are ISO-8601 date strings.

If you are providing a time portion it's strongly recommended that you provide the timezone in the string, otherwise a UTC timezone will be presumed

Email addresses and email hashing

Email addresses are commonly used for unification and activation throughout your CDXP and integrated platforms. While the Lexer CDXP has a loose definition of an email, we recommend checking your email addresses against this regex:

(^[a-zA-Z0-9_.+-]+@[a-zA-Z0-9-]+\.[a-zA-Z0-9-.]+$)

To ensure the highest matching success, we lowercase all email data, and may reject malformed email addresses.

*Note that downstream platforms such as ESPs and Social Ad Networks can have strict policies on what is considered a valid email. This might cause profiles that don’t match their own policies to be rejected.

Hashing

We hash email data internally, as many activation platforms only accept hashed email data.

If you choose to provide hashed (SHA-256) email data, you should:

  • Remove leading/trailing whitespaces.
  • Convert the text to lowercase.

Genders

We accept any string value as a representation of genders. This format can allow you to use any genders, the key is to keep the format consistent. 

It’s worth considering that consistent gender data can have a significant impact on your team’s use of the CDXP. For example, you may want to clean your data to ensure genders are in a consistent format, i.e. “Female” versus “F”. 

Phone numbers

Phone numbers, mobile numbers, or cell numbers are commonly used for unification and activation throughout the CDXP and integrated platforms.

You should convert each phone number, mobile number, or cell number to E164 format. This format represents a phone number as a number up to fifteen digits, starting with a + sign (e.g. +12125650000, +442070313000).

*Note: Downstream platforms such as SMS platforms and Social Ad Networks can have strict policies on what is considered a valid number. If their required format is not used, they may reject profiles.

Multi-lingual text data

The Lexer platform supports multi-byte data in a UTF-8 format. You will not need to convert or translate data formatted as such, but note that the Lexer platform does not do any language conversion. Data will be presented in the language and format provided.

Updated:
February 2, 2024
Did this page help you?
Thank you! Your feedback has been received!
Oops! Something went wrong while submitting the form, for assistance please contact support@lexer.io
Welcome to Lexer!
Fundamentals
Getting started
Our glossary
Fundamentals
Getting started
Integrations
Fundamentals
Setup
My account
Fundamentals
Setup
Manage team
Fundamentals
Setup
Group permissions
Fundamentals
Setup
Classifications
Fundamentals
Setup
Out of the box segments
Fundamentals
Setup
Lexi your AI companion
Fundamentals
Lexi
Browser guide
Fundamentals
Security
Corporate networks
Fundamentals
Security
Multi-factor authentication
Fundamentals
Security
Single sign-on
Fundamentals
Security
Lexer's Identity Resolution
Fundamentals
Identity Resolution
Lexer's ultimate troubleshooting guide
Fundamentals
Troubleshooting
Troubleshooting tech issues
Fundamentals
Troubleshooting
Troubleshooting integrations
Fundamentals
Troubleshooting
Troubleshooting Activate
Fundamentals
Troubleshooting
Troubleshooting Respond
Fundamentals
Troubleshooting
Help! My data is missing from the Hub
Fundamentals
Troubleshooting
How data is ingested into the CDP
Data
Self Serve Onboarding
Getting started onboarding data
Data
Self Serve Onboarding
Understanding APIs
Data
Self Serve Onboarding
Providing JSON data to Lexer
Data
Self Serve Onboarding
Providing CSV data to Lexer
Data
Self Serve Onboarding
Upload using SFTP
Data
Self Serve Onboarding
Secure file upload
Data
Self Serve Onboarding
Upload using S3
Data
Self Serve Onboarding
Lexer data specification
Data
Data Specification
Customer data specification
Data
Data Specification
Commerce data specification
Data
Data Specification
Marketing data specification
Data
Data Specification
Compliance data specification
Data
Data Specification
Rate limits
Data
APIs
Product imagery
Data
Formatting
Currency conversion
Data
Formatting
Dataset management
Data
Datasets
Chatbot API
Data
APIs
Activity API
Data
APIs
Visualize API
Hidden from nav
Read API
Data
APIs
Lexer Javascript Tag basics
Data
Javascript Tag
Export to CSV
Measure
Listen
Data in the CDXP
Data
Customer Data
CRM data
Data
Customer Data
Transaction data
Data
Customer Data
Email data
Data
Customer Data
Experian
Data
Partner data
Segment overview
Understand
Segment
Creating segments
Understand
Segment
Smart Search
Understand
Segment
Export attribute results
Understand
Segment
Fixing a disabled segment
Understand
Segment
Profile tab
Understand
Segment
Event Explorer
Understand
Segment
Lexer's attributes
Understand
Attributes
Predictive attributes
Understand
Attributes
Attribute value types
Understand
Attributes
Compare segments
Understand
Compare
Compare attributes
Understand
Compare
Activate overview
Engage
Activate
Ongoing activations
Engage
Activate
Audience splits
Engage
Activate
A/B splits
Engage
Activate
Control group splits
Engage
Activate
Inbox filtering
Engage
Respond
Ignored Senders
Engage
Respond
Forms for service
Engage
Respond
Workflow states
Engage
Respond
Bulk changes
Engage
Respond
Scheduled replies
Engage
Respond
Message templates
Engage
Respond
Customer profiles
Engage
Respond
Grouped messages
Engage
Respond
Automation rules
Engage
Respond
Redact messages
Engage
Respond
Contact Reporting
Engage
Contact
Serve Forms
Engage
Serve
Serve Reports
Engage
Serve
Serve Currency
Engage
Serve
Track overview
Measure
Track
Track Tables
Measure
Track
Activity overview
Measure
Activity
Team report
Measure
Activity
Cases report
Measure
Activity
Listen overview
Measure
Listen
Searching in Listen
Measure
Listen
Tier filters
Measure
Listen
Boolean search
Measure
Listen
Saved dives
Measure
Listen
Email notifications
Measure
Listen
Twitter data
Measure
Listen
Facebook data
Measure
Listen
Visualize overview
Measure
Visualize
Curate feed
Measure
Visualize
Report overview
Measure
Report
Lexer Product Recommender → Klaviyo Integration
Grow
Lexer Product Recommender → Klaviyo Integration
Where do your best customers live? Use geographic insights to maximize media spend and conversion
Grow
Where do your best customers live? Use geographic insights to maximize media spend and conversion
Suppression audiences: How to use them and maximize your media effectiveness
Enrich
Suppression audiences: How to use them and maximize your media effectiveness
Measure campaign effectiveness: Track your KPIs and report on campaign performance
Enrich
Measure campaign effectiveness: Track your KPIs and report on campaign performance
Converting prospects: Acquire customers from your current, engaged prospect base (and save your ad spend!)
Acquire
Converting prospects: Acquire customers from your current, engaged prospect base (and save your ad spend!)
Understanding customer intent: Effective message personalization for buyers who shop outside their gender
Grow
Understanding customer intent: Effective message personalization for buyers who shop outside their gender
Deepen customer understanding: Use third-party data to identify insights for personalized messaging and increased engagement
Grow
Deepen customer understanding: Use third-party data to identify insights for personalized messaging and increased engagement
Basket analysis: Increasing customer lifetime value through targeted product bundling
Grow
Basket analysis: Increasing customer lifetime value through targeted product bundling
Persona building: Personalize your messaging for maximum return on your campaign investments
Grow
Persona building: Personalize your messaging for maximum return on your campaign investments
Driving customer loyalty: Identify, keep, and grow your most loyal customers
Retain
Driving customer loyalty: Identify, keep, and grow your most loyal customers
Increasing customer lifetime value: Upselling strategies
Grow
Increasing customer lifetime value: Upselling strategies
Reactivating lapsed customers: Retention and growth
Retain
Reactivating lapsed customers: Retention and growth
Welcome offer strategies: Using the Hub for analysis
Acquire
Welcome offer strategies: Using the Hub for analysis
Creating customer forms: Best practices
Enrich
Creating customer forms: Best practices
Connecting your MarTech stack with Lexer!
Enrich
Connecting your MarTech stack with Lexer!
Identifying win-back customers using the Second Last Order: Date attribute
Retain
Identifying win-back customers using the Second Last Order: Date attribute
Understanding customers' purchasing habits: Order Sequence filter
Grow
Understanding customers' purchasing habits: Order Sequence filter
Maximizing customer communications in Respond
Retain
Maximizing customer communications in Respond
Using Product Recommendation in the Hub to encourage repeat purchases
Grow
Using Product Recommendation in the Hub to encourage repeat purchases
Encouraging customer loyalty using birthday campaigns
Retain
Encouraging customer loyalty using birthday campaigns
Increasing customer lifetime value: Converting your one-time buyers into two-time buyers
Grow
Increasing customer lifetime value: Converting your one-time buyers into two-time buyers
Collecting zero-party data using Lexer Forms
Enrich
Collecting zero-party data using Lexer Forms
Measuring your data over time with Track
Enrich
Measuring your data over time with Track
UTM Creation Guidelines
UTM Creation Guidelines
UTM Creation Guidelines
Brand Assets
Brand Assets
Brand Assets
GTM guide to creating marketing materials with Lexer
GTM guide to creating marketing materials with Lexer
GTM guide to creating marketing materials with Lexer
How to use the Lexer Form Builder
How to use the Lexer Form Builder
How to use the Lexer Form Builder
Explore our standard integrations
Explore our standard integrations
Explore our standard integrations
Operating a CDP Practice LP
Operating a CDP Practice LP
Operating a CDP Practice LP
LP Sales Enablement
LP Sales Enablement
LP Sales Enablement
Video Training Courses LP
Video Training Courses LP
Video Training Courses LP
Purpose and Mission
Purpose and Mission
Purpose and Mission
Brand & Marketing LP
Brand & Marketing LP
Brand & Marketing LP
Stage 3 - QBRs and Customer insights
Stage 3 - QBRs and Customer insights
Stage 3 - QBRs and Customer insights
Client Onboarding Journey
Client Onboarding Journey
Client Onboarding Journey
Start your CDP Practice
Start your CDP Practice
Start your CDP Practice
Lexer Messaging
Lexer Messaging
Lexer Messaging
Pain point conversations
Pain point conversations
Pain point conversations
Lexer Ideal Customer Profile & Positioning
Lexer Ideal Customer Profile & Positioning
Lexer Ideal Customer Profile & Positioning
Referral Partner Program Overview
Referral Partner Program Overview
Referral Partner Program Overview
Demo Hub Guide
Demo Hub Guide
Demo Hub Guide