The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

Latent Dirichlet Allocation - Iterations?

Soni
Soni Member Posts: 1 image Learner I
edited June 2019 in Help
Hi RapidMiner team,
I'm rather new to LDA and am a bit confused to what exactly the iterations parameter refers to since the description says "Number of iterations for optimization". However, as far as I understood it, the operator uses Gibbs sampling where the number of iterations should be set as well. Is it set using the iterations parameter or has the parameter something to do with optimizing the hyperparameters (whereby the input field does not disappear if I uncheck the hyperparameter optimization)?

Thanks in advance!

Tagged:

Best Answer

Answers

  • MarlaBot
    MarlaBot Employee-RapidMiner, Member Posts: 57 image Community Manager
    Hi @Soni - this is MarlaBot. I found these great videos on our RapidMiner Academy that you may find helpful:
    Instructional Video: Applying a Model to categorize Documents (Viewing time: ~11m)
    Instructional Video: Text Association Rules (Viewing time: ~10m)
    Please LIKE my comment if it helps! 👇

    MarlaBot <3
  • RickB
    RickB Member Posts: 3 image Learner I
    Hi @mschmitz, I am currently trying to analyze short text documents for a research project, and I was wondering if there is a way to do Gibbs Sampling (GSDMM) with RapidMiner? 
  • MartinLiebig
    MartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 image RM Data Scientist
    Hi @RickB,

    only inside LDA. Not as a standalone thing, sorry.

    Best,
    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • RickB
    RickB Member Posts: 3 image Learner I
    Hi @mschmitz, 

    Thank you for the quick response. I tried analyzing the data using LDA, but I did not see an option for Gibbs Sampling. Would you be able to direct me to where I can find that inside the LDA operator? 

    Best,

    Rich
  • MartinLiebig
    MartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 image RM Data Scientist
    Sorry? I don't understand the question. The LDA we use internally is from Mallet. The operator executes similar code to whats shown here:
    What would you expect?

    Best,
    Martin

    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany

Categories