{"id":4419,"date":"2024-02-01T19:09:18","date_gmt":"2024-02-01T18:09:18","guid":{"rendered":"https:\/\/bioinfo.ird.fr\/?page_id=4419"},"modified":"2025-10-01T09:32:27","modified_gmt":"2025-10-01T07:32:27","slug":"how-to-use-the-infiniband-network-2","status":"publish","type":"page","link":"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/","title":{"rendered":"How to use the infiniband network"},"content":{"rendered":"

How to use the infiniband network to transfer faster<\/h2>\n\n\n\n\n\n\n\n
Description<\/th>\nUse the --constraint option of Slurm<\/th>\n<\/tr>\n<\/thead>\n
Author<\/td>\nndomassi TANDO (ndomassi.tando@ird.fr)<\/td>\n<\/tr>\n
Creation Date<\/td>\n01\/02\/2024<\/td>\n<\/tr>\n
Last Modified Date<\/td>\n01\/10\/2025<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

Role of the Infiniband network:<\/h3>\n

The infiniband network (192.168.4.0)\u00a0 allows users to have access to an high speed network to transfer their data from the san to the nodes or between infiniband nodes.<\/p>\n

Only certain nodes are equiped with infiniband for now , check the list below:<\/p>\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
node<\/th>\npartitions<\/th>\nCPU<\/th>\nRAM total (Gb)<\/th>\nRAM by CPU (Gb\/cpu)<\/th>\nscratch size (To)<\/th>\n<\/tr>\n<\/thead>\n
node0<\/td>\nnormal<\/td>\n24<\/td>\n144<\/td>\n6<\/td>\n13<\/td>\n<\/tr>\n
node1<\/td>\nnormal<\/td>\n24<\/td>\n144<\/td>\n6<\/td>\n2<\/td>\n<\/tr>\n
node2<\/td>\nsupermem<\/td>\n256<\/td>\n2063<\/td>\n7<\/td>\n13<\/td>\n<\/tr>\n
node4<\/td>\nnormal<\/td>\n72<\/td>\n257<\/td>\n4<\/td>\n13<\/td>\n<\/tr>\n
node5<\/td>\nnormal<\/td>\n88<\/td>\n516<\/td>\n6<\/td>\n13<\/td>\n<\/tr>\n
node7<\/td>\nnormal<\/td>\n24<\/td>\n145<\/td>\n6<\/td>\n3<\/td>\n<\/tr>\n
node8<\/td>\nlong<\/td>\n24<\/td>\n48<\/td>\n2<\/td>\n13<\/td>\n<\/tr>\n
node9<\/td>\nnormal<\/td>\n64<\/td>\n144<\/td>\n2<\/td>\n13<\/td>\n<\/tr>\n
node11<\/td>\nrunner<\/td>\n24<\/td>\n48<\/td>\n2<\/td>\n3<\/td>\n<\/tr>\n
node17<\/td>\nnormal<\/td>\n48<\/td>\n144<\/td>\n3<\/td>\n13<\/td>\n<\/tr>\n
node20<\/td>\nnormal<\/td>\n20<\/td>\n64<\/td>\n3<\/td>\n13<\/td>\n<\/tr>\n
node21<\/td>\nnormal<\/td>\n24<\/td>\n144<\/td>\n6<\/td>\n13<\/td>\n<\/tr>\n
node24<\/td>\nnormal<\/td>\n20<\/td>\n64<\/td>\n3<\/td>\n13<\/td>\n<\/tr>\n
node25<\/td>\nhighmem<\/td>\n40<\/td>\n1\u202f032<\/td>\n26<\/td>\n14<\/td>\n<\/tr>\n
node26<\/td>\ngpu<\/td>\n24<\/td>\n192<\/td>\n8<\/td>\n14<\/td>\n<\/tr>\n
node27<\/td>\nnormal<\/td>\n24<\/td>\n144<\/td>\n6<\/td>\n14<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

Reserving node in the Infiniband network:<\/h3>\n

To use the infiniband network, we have to add the "-ib" siffix to the alias of the machine, for example san will become san-ib, node0 will become node0-ib etc...<\/p>\n

Use the options\u00a0 \u00a0 -p partition ( with partition being the node partition) --constraint=infiniband to reserve one or several cores on a infiniband node. ( cf feature page<\/a> ) for more explanations.
\nFor example, we want to reserve an infiniband node on highmem partition in a interactive mode, type the following command:<\/p>\n

<\/codesrun>srun -p highmem --constraint=infiniband --pty bash -i<\/code><\/div>\n

You now have access to the infiniband network, to use it just change the alias san to san-ib to do your transfers .<\/p>\n

Transfer your data via Infiniband:<\/h3>\n

There are 2 possible syntaxes:<\/p>\n

Retrieve data from the san:<\/h4>\n

scp -r san-ib:path_to_files\/file local_destination<\/code><\/p>\n<\/p>\n

Transfer data to the san:<\/h4>\n

scp -r \/local_path_to_files\/file san-ib:remote_destination<\/code><\/p>\n","protected":false},"excerpt":{"rendered":"

How to use the infiniband network to transfer faster Description Use the –constraint option of Slurm Author ndomassi TANDO (ndomassi.tando@ird.fr)…
Lire la suite<\/a><\/p>\n","protected":false},"author":5,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"inline_featured_image":false,"footnotes":""},"class_list":["post-4419","page","type-page","status-publish","hentry"],"yoast_head":"\nHow to use the infiniband network - itrop<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to use the infiniband network - itrop\" \/>\n<meta property=\"og:description\" content=\"How to use the infiniband network to transfer faster Description Use the --constraint option of Slurm Author ndomassi TANDO (ndomassi.tando@ird.fr)… Lire la suite\" \/>\n<meta property=\"og:url\" content=\"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/\" \/>\n<meta property=\"og:site_name\" content=\"itrop\" \/>\n<meta property=\"article:modified_time\" content=\"2025-10-01T07:32:27+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@ItropBioinfo\" \/>\n<meta name=\"twitter:label1\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/\",\"url\":\"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/\",\"name\":\"How to use the infiniband network - itrop\",\"isPartOf\":{\"@id\":\"https:\/\/bioinfo.ird.fr\/#website\"},\"datePublished\":\"2024-02-01T18:09:18+00:00\",\"dateModified\":\"2025-10-01T07:32:27+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/bioinfo.ird.fr\/index.php\/en\/front-page-2\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to use the infiniband network\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/bioinfo.ird.fr\/#website\",\"url\":\"https:\/\/bioinfo.ird.fr\/\",\"name\":\"itrop\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/bioinfo.ird.fr\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/bioinfo.ird.fr\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/bioinfo.ird.fr\/#organization\",\"name\":\"i-Trop\",\"url\":\"https:\/\/bioinfo.ird.fr\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/bioinfo.ird.fr\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/bioinfo.ird.fr\/wp-content\/uploads\/2021\/10\/i-tropTwt5.png\",\"contentUrl\":\"https:\/\/bioinfo.ird.fr\/wp-content\/uploads\/2021\/10\/i-tropTwt5.png\",\"width\":1356,\"height\":1356,\"caption\":\"i-Trop\"},\"image\":{\"@id\":\"https:\/\/bioinfo.ird.fr\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/ItropBioinfo\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to use the infiniband network - itrop","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/","og_locale":"fr_FR","og_type":"article","og_title":"How to use the infiniband network - itrop","og_description":"How to use the infiniband network to transfer faster Description Use the --constraint option of Slurm Author ndomassi TANDO (ndomassi.tando@ird.fr)… Lire la suite","og_url":"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/","og_site_name":"itrop","article_modified_time":"2025-10-01T07:32:27+00:00","twitter_card":"summary_large_image","twitter_site":"@ItropBioinfo","twitter_misc":{"Dur\u00e9e de lecture estim\u00e9e":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/","url":"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/","name":"How to use the infiniband network - itrop","isPartOf":{"@id":"https:\/\/bioinfo.ird.fr\/#website"},"datePublished":"2024-02-01T18:09:18+00:00","dateModified":"2025-10-01T07:32:27+00:00","breadcrumb":{"@id":"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/bioinfo.ird.fr\/index.php\/how-to-use-the-infiniband-network-2\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/bioinfo.ird.fr\/index.php\/en\/front-page-2\/"},{"@type":"ListItem","position":2,"name":"How to use the infiniband network"}]},{"@type":"WebSite","@id":"https:\/\/bioinfo.ird.fr\/#website","url":"https:\/\/bioinfo.ird.fr\/","name":"itrop","description":"","publisher":{"@id":"https:\/\/bioinfo.ird.fr\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/bioinfo.ird.fr\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/bioinfo.ird.fr\/#organization","name":"i-Trop","url":"https:\/\/bioinfo.ird.fr\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/bioinfo.ird.fr\/#\/schema\/logo\/image\/","url":"https:\/\/bioinfo.ird.fr\/wp-content\/uploads\/2021\/10\/i-tropTwt5.png","contentUrl":"https:\/\/bioinfo.ird.fr\/wp-content\/uploads\/2021\/10\/i-tropTwt5.png","width":1356,"height":1356,"caption":"i-Trop"},"image":{"@id":"https:\/\/bioinfo.ird.fr\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/ItropBioinfo"]}]}},"_links":{"self":[{"href":"https:\/\/bioinfo.ird.fr\/index.php\/wp-json\/wp\/v2\/pages\/4419","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bioinfo.ird.fr\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/bioinfo.ird.fr\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/bioinfo.ird.fr\/index.php\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/bioinfo.ird.fr\/index.php\/wp-json\/wp\/v2\/comments?post=4419"}],"version-history":[{"count":8,"href":"https:\/\/bioinfo.ird.fr\/index.php\/wp-json\/wp\/v2\/pages\/4419\/revisions"}],"predecessor-version":[{"id":4782,"href":"https:\/\/bioinfo.ird.fr\/index.php\/wp-json\/wp\/v2\/pages\/4419\/revisions\/4782"}],"wp:attachment":[{"href":"https:\/\/bioinfo.ird.fr\/index.php\/wp-json\/wp\/v2\/media?parent=4419"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}