How do I find the most frequent sub sets for this data?

leomonneret

Hello everyone!
I have tried to apply many different operators to this data set so it runs through FP-Growth but no matter what I do, FP-Growth does not display any subsets at all. 
The best I can get is "true" and "false" results. 
I think maybe I could be a problem with the dataset, so I tried using aggregate concatenation to have it as a list but it still does not seem to produce the right results. 

I will join the data set to my question if someone could help me it would be really great!

Thanks a lot rapidminer community!

SGolbert

Hi @leomonneret

I developed a process with your data:

<?xml version="1.0" encoding="UTF-8"?><process version="9.1.000"><br>  <context><br>    <input/><br>    <output/><br>    <macros/><br>  </context><br>  <operator activated="true" class="process" compatibility="9.1.000" expanded="true" name="Process"><br>    <parameter key="logverbosity" value="init"/><br>    <parameter key="random_seed" value="2001"/><br>    <parameter key="send_mail" value="never"/><br>    <parameter key="notification_email" value=""/><br>    <parameter key="process_duration_for_mail" value="30"/><br>    <parameter key="encoding" value="SYSTEM"/><br>    <process expanded="true"><br>      <operator activated="false" class="read_excel" compatibility="9.1.000" expanded="true" height="68" name="Read Excel" width="90" x="246" y="238"><br>        <parameter key="excel_file" value="C:\Users\sgolbert\Downloads\Supermarket2014-15.xls"/><br>        <parameter key="sheet_selection" value="sheet number"/><br>        <parameter key="sheet_number" value="1"/><br>        <parameter key="imported_cell_range" value="A1"/><br>        <parameter key="encoding" value="SYSTEM"/><br>        <parameter key="first_row_as_names" value="true"/><br>        <list key="annotations"/><br>        <parameter key="date_format" value=""/><br>        <parameter key="time_zone" value="SYSTEM"/><br>        <parameter key="locale" value="English (United States)"/><br>        <parameter key="read_all_values_as_polynominal" value="false"/><br>        <list key="data_set_meta_data_information"><br>          <parameter key="0" value="Day.true.integer.attribute"/><br>          <parameter key="1" value="Product.true.polynominal.attribute"/><br>        </list><br>        <parameter key="read_not_matching_values_as_missings" value="false"/><br>        <parameter key="datamanagement" value="double_array"/><br>        <parameter key="data_management" value="auto"/><br>      </operator><br>      <operator activated="false" class="store" compatibility="9.1.000" expanded="true" height="68" name="Store" width="90" x="648" y="238"><br>        <parameter key="repository_entry" value="../data/supermarket"/><br>      </operator><br>      <operator activated="true" class="retrieve" compatibility="9.1.000" expanded="true" height="68" name="Retrieve supermarket" width="90" x="112" y="34"><br>        <parameter key="repository_entry" value="../data/supermarket"/><br>      </operator><br>      <operator activated="true" class="trim" compatibility="9.1.000" expanded="true" height="82" name="Trim" width="90" x="246" y="34"><br>        <parameter key="attribute_filter_type" value="single"/><br>        <parameter key="attribute" value="Product"/><br>        <parameter key="attributes" value=""/><br>        <parameter key="use_except_expression" value="false"/><br>        <parameter key="value_type" value="nominal"/><br>        <parameter key="use_value_type_exception" value="false"/><br>        <parameter key="except_value_type" value="file_path"/><br>        <parameter key="block_type" value="single_value"/><br>        <parameter key="use_block_type_exception" value="false"/><br>        <parameter key="except_block_type" value="single_value"/><br>        <parameter key="invert_selection" value="false"/><br>        <parameter key="include_special_attributes" value="false"/><br>      </operator><br>      <operator activated="true" class="replace" compatibility="9.1.000" expanded="true" height="82" name="Replace" width="90" x="380" y="34"><br>        <parameter key="attribute_filter_type" value="single"/><br>        <parameter key="attribute" value="Product"/><br>        <parameter key="attributes" value=""/><br>        <parameter key="use_except_expression" value="false"/><br>        <parameter key="value_type" value="nominal"/><br>        <parameter key="use_value_type_exception" value="false"/><br>        <parameter key="except_value_type" value="file_path"/><br>        <parameter key="block_type" value="single_value"/><br>        <parameter key="use_block_type_exception" value="false"/><br>        <parameter key="except_block_type" value="single_value"/><br>        <parameter key="invert_selection" value="false"/><br>        <parameter key="include_special_attributes" value="false"/><br>        <parameter key="replace_what" value="[ ]"/><br>        <parameter key="replace_by" value="|"/><br>      </operator><br>      <operator activated="true" class="set_role" compatibility="9.1.000" expanded="true" height="82" name="Set Role" width="90" x="514" y="34"><br>        <parameter key="attribute_name" value="Day"/><br>        <parameter key="target_role" value="id"/><br>        <list key="set_additional_roles"/><br>      </operator><br>      <operator activated="true" class="concurrency:fp_growth" compatibility="9.1.000" expanded="true" height="82" name="FP-Growth" width="90" x="648" y="34"><br>        <parameter key="input_format" value="item list in a column"/><br>        <parameter key="item_separators" value="|"/><br>        <parameter key="use_quotes" value="false"/><br>        <parameter key="quotes_character" value="&quot;"/><br>        <parameter key="escape_character" value="\"/><br>        <parameter key="trim_item_names" value="true"/><br>        <parameter key="min_requirement" value="support"/><br>        <parameter key="min_support" value="0.005"/><br>        <parameter key="min_frequency" value="100"/><br>        <parameter key="min_items_per_itemset" value="1"/><br>        <parameter key="max_items_per_itemset" value="0"/><br>        <parameter key="max_number_of_itemsets" value="1000000"/><br>        <parameter key="find_min_number_of_itemsets" value="false"/><br>        <parameter key="min_number_of_itemsets" value="100"/><br>        <parameter key="max_number_of_retries" value="15"/><br>        <parameter key="requirement_decrease_factor" value="0.9"/><br>        <enumeration key="must_contain_list"/><br>      </operator><br>      <operator activated="true" class="create_association_rules" compatibility="9.1.000" expanded="true" height="82" name="Create Association Rules" origin="GENERATED_TUTORIAL" width="90" x="782" y="34"><br>        <parameter key="criterion" value="confidence"/><br>        <parameter key="min_confidence" value="0.1"/><br>        <parameter key="min_criterion_value" value="0.8"/><br>        <parameter key="gain_theta" value="2.0"/><br>        <parameter key="laplace_k" value="1.0"/><br>      </operator><br>      <connect from_op="Read Excel" from_port="output" to_op="Store" to_port="input"/><br>      <connect from_op="Retrieve supermarket" from_port="output" to_op="Trim" to_port="example set input"/><br>      <connect from_op="Trim" from_port="example set output" to_op="Replace" to_port="example set input"/><br>      <connect from_op="Replace" from_port="example set output" to_op="Set Role" to_port="example set input"/><br>      <connect from_op="Set Role" from_port="example set output" to_op="FP-Growth" to_port="example set"/><br>      <connect from_op="FP-Growth" from_port="frequent sets" to_op="Create Association Rules" to_port="item sets"/><br>      <connect from_op="Create Association Rules" from_port="rules" to_port="result 1"/><br>      <connect from_op="Create Association Rules" from_port="item sets" to_port="result 2"/><br>      <portSpacing port="source_input 1" spacing="0"/><br>      <portSpacing port="sink_result 1" spacing="0"/><br>      <portSpacing port="sink_result 2" spacing="0"/><br>      <portSpacing port="sink_result 3" spacing="0"/><br>    </process><br>  </operator><br></process><br><br>

I think you only needed a bit of preprocessing.

Regards,

Sebastian

leomonneret

Thanks a lot, I am trying to repeat the same process in RapidMiner and I am struggling a bit but hopefully I'll manage. Thanks again for the help!