The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
"[SOLVED]Using k-means clustering on web log data"
I have a data set from a access web log file which I'm interested in finding similar clusters. (I'm an absolute beginner of data mining). So far I have referred many research papers on the same problem domain.
An Efficient Approach for Clustering Web Access Patterns from Web Logs
http://www.sersc.org/journals/IJAST/vol5/1.pdf
Classifying the user intent of web queries using k-means clustering
http://faculty.ist.psu.edu/jjansen/academic/jansen_user_intent_kmeans.pdf
I want to use k-means clustering to cluster web pages. Although these papers discuss about the algorithm, they do not specify the way of providing input data set. k-means calculate similarity between data points using Euclidean distance. So how to normalize my dataset to be mined using k-means since urls can not directly used for k-means. Any help/good reference on this?
Example Dataset(p1..pn are different web pages)
p1,p2,p3,p4
p1,p2
p1,p5,p6,p7
p1,p2,p3,p5
An Efficient Approach for Clustering Web Access Patterns from Web Logs
http://www.sersc.org/journals/IJAST/vol5/1.pdf
Classifying the user intent of web queries using k-means clustering
http://faculty.ist.psu.edu/jjansen/academic/jansen_user_intent_kmeans.pdf
I want to use k-means clustering to cluster web pages. Although these papers discuss about the algorithm, they do not specify the way of providing input data set. k-means calculate similarity between data points using Euclidean distance. So how to normalize my dataset to be mined using k-means since urls can not directly used for k-means. Any help/good reference on this?
Example Dataset(p1..pn are different web pages)
p1,p2,p3,p4
p1,p2
p1,p5,p6,p7
p1,p2,p3,p5
Tagged:
0
Answers
I'm not an expert but the way I would approach the problem is to create a table with p1...pn as columns and individual users as rows.
The values filling the table would be the count of how many times a page has been visited by the user.
Thanks for the reply, this is what exactly ended up in doing.