concurrency and jdbc_connectors extension not working when creating a fat jar using maven

jguzm029 · June 2018

Hi

Im trying to create a fat jar using maven in eclipse, so that i can run a rmp process. In the fat jar i have all the dependencies and extensions (concurrency, jdbc_connectors etc) that my rmp process needs to execute the process.
I am using maven in eclipse to create the fat jar.

When my fat jar is created and i run the jar file, i keep getting the error

"'concurrency:parallel_decision_tree' is unknown. Possibly you must install a plugin for operators of group 'concurrency'"

and,

'jdbc_connectors:read_database' is unknown. Possibly you must install a plugin for operators of group 'jdbc_connectors'

in Eclipse under the maven dependencies i have all the extensions that i need and also in the POM.xml i have stated all the dependencies for this process.

I do not know why the fat jar is telling me that it cannot find the plugins, even thoug the jar files for these plugins are included.

My RMP process is very simple, it just reads a DataBase, implements a decision tree and then it writes and excel file.

Here is the error i am getting:

INFO: The operator class 'jdbc_connectors:read_database' is unknown. Possibly you must install a plugin for operators of group 'jdbc_connectors'.
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'define_connection' is unknown for operator 'Read Database' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'database_system' is unknown for operator 'Read Database' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'define_query' is unknown for operator 'Read Database' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'use_default_schema' is unknown for operator 'Read Database' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'prepare_statement' is unknown for operator 'Read Database' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'parameters' of type enumeration is unknown for operator 'Read Database' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'datamanagement' is unknown for operator 'Read Database' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'data_management' is unknown for operator 'Read Database' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter addMessage
INFO: The operator class 'concurrency:parallel_decision_tree' is unknown. Possibly you must install a plugin for operators of group 'concurrency'.
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'criterion' is unknown for operator 'Decision Tree' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'maximal_depth' is unknown for operator 'Decision Tree' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'apply_pruning' is unknown for operator 'Decision Tree' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'confidence' is unknown for operator 'Decision Tree' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'apply_prepruning' is unknown for operator 'Decision Tree' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'minimal_gain' is unknown for operator 'Decision Tree' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'minimal_leaf_size' is unknown for operator 'Decision Tree' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'minimal_size_for_split' is unknown for operator 'Decision Tree' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter parseOperator
INFO: The parameter 'number_of_prepruning_alternatives' is unknown for operator 'Decision Tree' (" dummy ")."
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter addMessage
INFO: The output port <var>output</var> is unknown at operator <var>Read Database</var>.
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter addMessage
INFO: The input port <var>training set</var> is unknown at operator <var>Decision Tree</var>.
Jun 18, 2018 10:44:45 AM com.rapidminer.io.process.XMLImporter addMessage
INFO: The output port <var>model</var> is unknown at operator <var>Decision Tree</var>.
Exception in thread "main" java.lang.NullPointerException
at com.testingJar.tesingJar.App.main(App.java:70)

Here is my POM.xml file from Maven in eclipse:

<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">


  <modelVersion>4.0.0</modelVersion>
  <groupId>com.testingJar</groupId>
  <artifactId>tesingJar</artifactId>
  <version>0.0.1-SNAPSHOT</version>
  <packaging>jar</packaging>
  <name>tesingJar</name>
  <url>http://maven.apache.org</url&gt;

  <properties>
    <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
   </properties>

  <dependencies>
<dependency>
  <groupId>org.apache.commons</groupId>
  <artifactId>commons-lang3</artifactId>
  <version>3.7</version>
</dependency>
<dependency>
  <groupId>com.rapidminer.studio</groupId>
  <artifactId>rapidminer-studio-core</artifactId>
  <version>7.2.0</version>
</dependency>
  	<dependency>
  		<groupId>concurrent</groupId>
  		<artifactId>concurrent</artifactId>
  		<version>1.3.4</version>
  	</dependency>

  	<dependency>
  		<groupId>com.rapidminer.extension</groupId>
  		<artifactId>
  			rapidminer-extension-concurrency-8.2.0-all
  		</artifactId>
  		<version>1.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.rapidminer.extension</groupId>
  		<artifactId>
  			rapidminer-extension-jdbc-connectors-8.2.0-all
  		</artifactId>
  		<version>1.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.rapidminer.extension</groupId>
  		<artifactId>
  			rapidminer-extension-advanced-file-connectors-8.2.0-all
  		</artifactId>
  		<version>8.2.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.rapidminer.extension</groupId>
  		<artifactId>rapidminer-extension-legacy-8.2.0-all</artifactId>
  		<version>8.2.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.rapidminer.extension</groupId>
  		<artifactId>
  			rapidminer-extension-productivity-8.2.0-all
  		</artifactId>
  		<version>8.2.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.rapidminer.extension</groupId>
  		<artifactId>
  			rapidminer-extension-professional-8.2.0-all
  		</artifactId>
  		<version>8.2.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.rapidminer.extension</groupId>
  		<artifactId>
  			rapidminer-extension-remote-repository-8.2.0-all
  		</artifactId>
  		<version>8.2.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.rapidminer.extension</groupId>
  		<artifactId>cloud_connectivity-8.2.0-all</artifactId>
  		<version>8.2.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.rapidminer.extension</groupId>
  		<artifactId>cloud_execution-8.1.0-all</artifactId>
  		<version>8.1.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.rapidminer.extension</groupId>
  		<artifactId>dataeditor-7.3.0-all</artifactId>
  		<version>7.3.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.rapidminer.extension</groupId>
  		<artifactId>h2o-8.2.0-all</artifactId>
  		<version>8.2.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.rapidminer.extension</groupId>
  		<artifactId>operator_recommender-8.2.0-all</artifactId>
  		<version>8.2.0</version>
  	</dependency>
  </dependencies>
  <repositories>
  <repository>
    <id>rapidminer</id>
    <url>https://maven.rapidminer.com/content/groups/public/</url&gt;
  </repository>
</repositories>

<build>
  <plugins>
  			<!-- download source code in Eclipse, best practice -->
			<plugin>
				<groupId>org.apache.maven.plugins</groupId>
				<artifactId>maven-eclipse-plugin</artifactId>
				<version>2.9</version>
				<configuration>
					<downloadSources>true</downloadSources>
					<downloadJavadocs>false</downloadJavadocs>
				</configuration>
			</plugin>

			<!-- Set a compiler level -->
			<plugin>
				<groupId>org.apache.maven.plugins</groupId>
				<artifactId>maven-compiler-plugin</artifactId>
				<version>2.3.2</version>
				<configuration>
					<source>${jdk.version}</source>
					<target>${jdk.version}</target>
				</configuration>
			</plugin>


      <plugin>
        <groupId>org.apache.maven.plugins</groupId>
        <artifactId>maven-shade-plugin</artifactId>
        <version>3.1.1</version>
        <executions>
          <!-- Run Shade goal on package phase -->
          <execution>
            <phase>package</phase>
            <goals>
              <goal>shade</goal>
            </goals>
            <configuration>
              <transformers>
                        <transformer
                            implementation= "org.apache.maven.plugins.shade.resource.ManifestResourceTransformer">
                            <mainClass>com.testingJar.tesingJar.App</mainClass>
                        </transformer>
                    </transformers>


              <filters>
                <filter>
                  <artifact>junit:junit</artifact>
                  <includes>
                    <include>junit/framework/**</include>
                    <include>org/junit/**</include>
                  </includes>
                  <excludes>
                    <exclude>org/junit/experimental/**</exclude>
                    <exclude>org/junit/runners/**</exclude>
                  </excludes>
                </filter>
                <filter>
                  <artifact>*:*</artifact>
                  <excludes>
                    <exclude>META-INF/*.SF</exclude>
                    <exclude>META-INF/*.DSA</exclude>
                    <exclude>META-INF/*.RSA</exclude>
                  </excludes>
                </filter>
              </filters>
            </configuration>
          </execution>
        </executions>
      </plugin>   
  </plugins>
</build>

</project>

all the extensions are in the remote repository .m2

Please hel me with this issue i am very frustrated about this

I appreciate any help or orientation

Thank you

juasu56 · July 2018

hi !

did you find any solution ? i have the same problem

Howdy, Stranger!

Quick Links

Categories

Altair RapidMiner Community

GET HELP. LEARN BEST PRACTICES. NETWORK WITH YOUR PEERS.

concurrency and jdbc_connectors extension not working when creating a fat jar using maven

Answers