Skip to content

About

Using semantic search as a blocking approach to record linkage

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

9 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

semantic_record_linkage: This notebook illustrates how I use semantic search to perform deduplication of a synthetic dataset compiled by Ted Enamorado. It employs the "all-MiniLM-L6-v2" sentence transformer model to convert text into numerical vector embeddings, allowing similarity search algorithms to identify and pair potential duplicates in the dataset.

About

Using semantic search as a blocking approach to record linkage

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages