The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

Text Mining - Document Similarity/Clustering

sangeet171188sangeet171188 Member Posts: 8 Contributor II
edited September 2019 in Help

I have a 100K  text records, each have a problem description. now want to achieve :

1) Take a count of "Similar" looking problem description. (How to achieve this)

2) Main roadblocker is that it takes a lifetime to run process.

Steps :

Data import-->select attributes-->Process document to Data(tokenize.stopwords,n grams)-->K means/DBSCAN

 

How can I optimize this to run faster.

I can make Process documen to Data to run faster, but the Clustering takes away more than a day to run.

 

I am using community verison 7.5. Please suggest how can I decrease run time. And will enterprise version solve the problem ?

Tagged:

Answers

Sign In or Register to comment.