The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
operating generate N-Grams
Contributor II
Hello. friends of comunity .One question.
What heuristic applies operator "generate N-Grams" ?
The question I have is,
if my text delete the stop words and generate N-Grams applied with N = 4.
How to recognize the terms of 4 or 3 or 2 words?
regards
What heuristic applies operator "generate N-Grams" ?
The question I have is,
if my text delete the stop words and generate N-Grams applied with N = 4.
How to recognize the terms of 4 or 3 or 2 words?
regards
0
Answers
to be honest, I don't understand the question. N-Grams does not apply any heuristic, it simply combines N, in your case 4, tokens to one new token. If you removed the stopwords before, no stopwords will be used for the N-Grams.
Best regards,
Marius