I have many users and each user has an associated vector. I would like to compute the cosine similarity between each user. This is prohibitive based on the size. It seems LSH is a good approximatio...

I'm joining 2 datasets using Apache Spark ML LSH's approxSimilarityJoin method, but I'm seeings some strange behaviour. After the (inner) join the dataset is a bit skewed, however every time one o...

I am trying to apply BucketedRandomProjectionLSH's function model.approxNearestNeighbors(df, key, n) on all the rows of a dataframe in order to approx-find the top n most similar items for every it...

I am using approxSimilarityJoin to find Jaccard similarity between two sets. val dfA = hashtoseq.toDF("id","values") //values is a set of string val hashingTF = new HashingTF().setInputCol("val...