The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

Latent Dirichlet Allocation - Iterations?

SoniSoni Member Posts: 1 Learner I
edited June 2019 in Help
Hi RapidMiner team,
I'm rather new to LDA and am a bit confused to what exactly the iterations parameter refers to since the description says "Number of iterations for optimization". However, as far as I understood it, the operator uses Gibbs sampling where the number of iterations should be set as well. Is it set using the iterations parameter or has the parameter something to do with optimizing the hyperparameters (whereby the input field does not disappear if I uncheck the hyperparameter optimization)?

Thanks in advance!

Tagged:

Best Answer

Answers

  • MarlaBotMarlaBot Employee-RapidMiner, Member Posts: 57 Community Manager
    Hi @Soni - this is MarlaBot. I found these great videos on our RapidMiner Academy that you may find helpful:
    Instructional Video: Applying a Model to categorize Documents (Viewing time: ~11m)
    Instructional Video: Text Association Rules (Viewing time: ~10m)
    Please LIKE my comment if it helps! 👇

    MarlaBot <3
  • RickBRickB Member Posts: 3 Learner I
    Hi @mschmitz, I am currently trying to analyze short text documents for a research project, and I was wondering if there is a way to do Gibbs Sampling (GSDMM) with RapidMiner? 
  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    Hi @RickB,

    only inside LDA. Not as a standalone thing, sorry.

    Best,
    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • RickBRickB Member Posts: 3 Learner I
    Hi @mschmitz, 

    Thank you for the quick response. I tried analyzing the data using LDA, but I did not see an option for Gibbs Sampling. Would you be able to direct me to where I can find that inside the LDA operator? 

    Best,

    Rich
  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    Sorry? I don't understand the question. The LDA we use internally is from Mallet. The operator executes similar code to whats shown here:
    What would you expect?

    Best,
    Martin

    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
Sign In or Register to comment.