wiki:MolgenisBatchLoading

Back to MolgenisGuide

Batch loading of data

MOLGENIS also provides methods to quickly load large data sets from comma or tab separated data files in the UI. This works if:

  • The column headers match the entity field definitions as defined in MolgenisDatabaseXml file(order doesn’t matter)
  • A special case are XrefFields that either can use the xref_field or the xref_label. For example in the case of AddressBookExample? ‘contact_id’ and ‘contact_displayname’.

Loading csv data using the UI

You can use the AddressBookExample? as example. Within the MOLGENIS user interface for Contacts choose ‘File’ and then ‘Add in batch’.

Load data for Contact.

Within the MOLGENIS user interface for Contacts choose ‘File’ and then ‘Add in batch’.

In the CSV data dialog paste the following comma seperated values:

displayname,lastname,firstname,mid_initials,birthday

Prof.dr. R Bischoff,Bischoff,Rainer,,

Dr. R Breitling,Breitling,Rainer,,

Prof.dr. RC Jansen,Ritsert,Jansen,C,

Load data for Address, including 'xref by name'

In the dialog for Example data for Address again choose ‘File’ and then ‘Add in batch’. Set the ‘address_type’ to ‘work’ as constant for all addresses to be loaded (otherwise you get an error!). Then paste in the CSV data dialog:

phone,contact_displayname

+31 (0)50 3633338,Prof.dr. R Bischoff

+31 (0)50-3638088,Dr. R Breitling

+31 (0)50-3638089,Prof.dr. RC Jansen

Notice the cross reference by ‘xref_label’ using ‘contact_displayname’!


 [1] These example data was copied from  http://www.nbic.nl/nbic/network/?city=Groningen

Attachments