Documentation/CLI In Context: Difference between revisions

From Commontk
Jump to navigationJump to search
No edit summary
Line 79: Line 79:
[http://www.taverna.org.uk/download/workbench/ Taverna Workbench] is an open source Workflow Management System written in Java. GIMIAS's Command Line Plugins (CLPs) can be used in Taverna Workbench for creating medical imaging workflows composed of several filters. In order to be able to do this, the '''Center Computational Imaging and Simulation Technologies in Biomedicine (CISTIB)''' at the [http://www.shef.ac.uk/ University of Sheffield] has created a Taverna Workbench plugin for GIMIAS.
[http://www.taverna.org.uk/download/workbench/ Taverna Workbench] is an open source Workflow Management System written in Java. GIMIAS's Command Line Plugins (CLPs) can be used in Taverna Workbench for creating medical imaging workflows composed of several filters. In order to be able to do this, the '''Center Computational Imaging and Simulation Technologies in Biomedicine (CISTIB)''' at the [http://www.shef.ac.uk/ University of Sheffield] has created a Taverna Workbench plugin for GIMIAS.


In this interoperability test, a CTK Command Line Module was created and tested with GIMIAS Command-Line Taverna Plugin. The result was successful, which means that '''GIMIAS's CLPs and CTK's Command Line Modules can be combined to create processing workflows in Taverna Workbench !!'''.
General instructions on how to install GIMIAS Command-Line Taverna Plugin can be found [https://drive.google.com/file/d/0B3kBRNGHGeP0dE53THFMYjdsdDQ/edit?usp=sharing here].


The sample plugin is called '''CopyPlugin'''. It is a simple code to open a VTK ASCII file containing a PolyData, and save the contents of the file on another VTK file. The plugin code can be accessed [https://drive.google.com/file/d/0B3kBRNGHGeP0bVZVWHZkS1NydnM/edit?usp=sharing here].
In this interoperability test, a CTK Command Line Module was created and tested with GIMIAS Command-Line Taverna Plugin. The sample plugin is called '''CopyPlugin'''. It is a simple code to open a VTK ASCII file containing a PolyData, and save the contents of the file on another VTK file. The plugin code can be accessed [https://drive.google.com/file/d/0B3kBRNGHGeP0bVZVWHZkS1NydnM/edit?usp=sharing here].


GIMIAS Command-Line Taverna Plugin can be installed from [http://repository.cistib.org/nexus/content/repositories/GCLTP_Snapshot here].
The result was successful, which means that '''GIMIAS's CLPs and CTK's Command Line Modules can be combined to create processing workflows in Taverna Workbench !!''', as shown in the following images
 
General instructions on how to install a Taverna Plugin can be found [http://www.taverna.org.uk/documentation/taverna-plugins/ here], but for a more detailed guide, this [http://www.youtube.com/watch?v=XZ2pOHQwAcg video] shows how to install GIMIAS Command-Line Taverna Plugin (from minute 0:30). Notice that in the video Taverna Workbench is embedded in GIMIAS, but this is not necessary to install the plugin. Simply install Taverna Workbench and use the video to guide you through the installation process of the plugin.
 
The plugin requires [http://www.taverna.org.uk/download/workbench/2-4/ Taverna Workbench 2.4] and at least [http://www.oracle.com/technetwork/java/javase/downloads/java-archive-downloads-javase7-521261.html Java 7u17] to work.

Revision as of 11:19, 7 November 2013

Home < Documentation < CLI In Context

This page lists some example and notes on different integration of CLI modules in different frameworks including CTK (see Documentation/Command_Line_Interface). The first interoperability testing was done during the third VPH NoE Imaging workshop hold in Lyon, France on October 22-23, 2012. It will be continued in consecutive hackfests. The aim is to try to plug in CLI modules in CLI compatible frameworks and come up with possible improvement of the CLI standard, advice to CLI module and CLI framework developers.

Events

  • CTK Hackfest in Sophia Antipolis, France in November 2011
    • Preliminary work to integrate CLI into GIMIAS
  • CTK Hackfest in Boston, USA in July 2012
    • Preliminary work to integrate CLI into MITK
  • 3rd VPH NoE Imaging workshop in Lyon, France on October 22-23, 2012
  • CTK Hackfest in Bologna, Italy on December, 2012
    • Preliminary work to integrate CLI into medInria, MAF3
    • Semi-Automatic framework CLI integration tests
  • CTK Hackfest in London, UK on November, 2013
    • Second Interoperability tests: GIMIAS's Command Line Plugins in CTK's Command Line Module Explorer, CTK's Command Line Modules in Taverna Workbench

First Interoperability tests

These first tests mainly concern the integration of niftyreg (registration algorithms from UCL). The different stages of integration are: load, execute and results. Meaning that the CLI module can be loaded. executed and provides the same results as if it was run only from the command line. The problems we encountered were:

  • GIMIAS does not support to have a `default` element different that `None` for the output, not sure about the `advanced` option for the `parameters` element
  • niftyreg was using `fileExtensions` with stars (`*.nii`) which is not supported by neither GIMIAS nor Slicer (the star is directly used in the file name)
  • The default output folder should be set to the user folder and not the running one, otherwise the CLI module can crash because they were denied access to write in that folder (for example `Program Files` under Windows)
  • What to do with CLI modules that have dependencies on shared libraries with the platform but of different versions? Platforms should have the option to only use the libraries shipped with the CLI module
  • Platforms should align the way they treat data since if two load data differently, the same CLI module could give different results

It would be interesting to create test CLI modules for these integration tests. For example one that exposes all possible types of options, one running a simple algorithm without any dependencies (as niftyreg) and one with dependencies.

Some thoughts on the tested platforms:

  • Niftyview has nice controls on the way CLI modules are found and loaded (control on the `XML` validation)
  • Slicer has a nice display of the loaded and non loaded CLI modules (appear in red, there could be more explanation why the loading failed)

Here are the snapshots of niftyreg on the different platforms:

  • CTK command line module explorer

Niftyreg-ctk.png

  • Slicer

Niftyreg-slicer.png

  • NiftyView

Niftyreg-niftyview.png

  • GIMIAS

Niftyreg-gimias.png

  • medInria

Medinria-cli-niftyreg.png

Second Interoperability tests

  • GIMIAS's Command Line Plugins in CTK's Command Line Module Explorer

This interoperability test was done under Windows 8. Similar steps can be performed in other platforms.

Typically, GIMIAS's Command Line Plugins (CLPs) are located in folder <GIMIAS_install_dir>\commandLinePlugins. However, the DLL dependencies of these CLPs are located in <GIMIAS_install_dir>. This is a problem when attempting to use GIMIAS's CLPs in CTK's Command Line Module Explorer (CLME), as the CLME will fail to load the CLPs.

This can be easily solved by copying GIMIAS's CLPs in a different folder, let's say <CLP_folder>, along with its DLL dependencies (for finding out the DLL dependencies of a CLP, a program such as Dependency Walker can be used).

After creating <CLP_folder> and copying the necessary files in it. Start CTK's CLME, go to menu "Module" and choose "Options". In "Module Settings" go to "Search Paths", and then add <CLP_folder> to the search paths. Press "OK" and the CLME will scan <CLP_folder> and load the CLPs.

If the loading process fails, you are probably missing a DLL dependency, close the CLME and go to the cache folder (<user_directory>\AppData\Local\CommonTK\CommandLineModuleExplorer\cache on MS Windows). Clear the content of that directory, add the additional DLL to <CLP_folder> and then start the CLME again.

If a CLP shows up in the list with a warning sign, place the mouse on top of the CLP's name and look at the warning message. Most likely the XML that defines the CLP has a compatibility problem with the CLME, which means that is does not adhere to the CTK XML Schema. See the definition of the Schema, correct the XML of the CLP, clear CLME's cache folder as described in the previous paragraph, and start the CLME again.

After following these steps, you will be able to see and use your CLP in the CLME. This means that you can share your GIMIAS's CLP with any CTK user at any time, by just sharing your CLPs executable file and its DLL dependencies.

The following image shows GIMIAS's CLPs loaded in CTK's CLME. The "Create a DICOM Series" CLP is selected. The "Settings" dialog is also shown, indicating how to add the CLPs directory to the CLME's search paths. Notice that some CLPs are shown with a warning sign, so their XML definitions has to be corrected.

GIMIAS CLPs on CTK CLME.png

  • CTK's Command Line Modules in Taverna Workbench

Taverna Workbench is an open source Workflow Management System written in Java. GIMIAS's Command Line Plugins (CLPs) can be used in Taverna Workbench for creating medical imaging workflows composed of several filters. In order to be able to do this, the Center Computational Imaging and Simulation Technologies in Biomedicine (CISTIB) at the University of Sheffield has created a Taverna Workbench plugin for GIMIAS.

General instructions on how to install GIMIAS Command-Line Taverna Plugin can be found here.

In this interoperability test, a CTK Command Line Module was created and tested with GIMIAS Command-Line Taverna Plugin. The sample plugin is called CopyPlugin. It is a simple code to open a VTK ASCII file containing a PolyData, and save the contents of the file on another VTK file. The plugin code can be accessed here.

The result was successful, which means that GIMIAS's CLPs and CTK's Command Line Modules can be combined to create processing workflows in Taverna Workbench !!, as shown in the following images