Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Libfabric supplies a program called fi_info to list the available providers for transferring data between nodes and processes.  The results list is sorted from highest to lowest performing.  Options can be given to filter according to various features or capabilities.  On systems with infiniband, the verbs provider is returned as the most performant interface.  On our systems without infiniband,   the 'tcp' provider is listed as the most performant. 

Our code follows this same pattern, so absent constraining parameters, libfabric chooses the highest performing interface it has access to.  The following kwargs exist to be able to narrow the selection:

  • ep_domain: Forces the use of a particular domain (physical network interface)
  • ep_fabric: Forces the use of a particular fabric
  • ep_provider: Forces the use of a particular provider

...