5:12 p.m.
Hello everybody.
I'm configuring two servers as lustre routers (Lustre 2.7) in order to
join TCP and IB networks. The documentation says that many routes can be
configured for LNET with or without priorities.
My question: If I don't specify any priority (both routers will have the
same priority), is there any kind of load balancing between routers?. Or
should I do it 'handmade', specifying different priorities for different
group of clients and servers?.
Thank you everybody.
--
*Jose Manuel Martínez García / Tel. 987 293 174 *
*Coordinador de Sistemas*
Fundación Centro de Supercomputación de Castilla y León
Edificio CRAI-TIC, Campus de Vegazana, s/n
Universidad de León
24071 León, España
www.fcsc.es
logoFCSCL jcyl
_________________________________
Este correo va dirigido, de manera exclusiva, a su destinatario y puede
contener información confidencial, cuya divulgación no está permitida
por la ley. Si usted no es su destinatario notifíquelo urgentemente al
remitente y borre este correo de su sistema.
Proteja el Medio Ambiente. Evite imprimir este mensaje si no es
estrictamente necesario.
2:23 a.m.
On Jul 30, 2015, at 3:12 AM, Jose Manuel Martínez
<jose.martinez(a)fcsc.es> wrote:
My question: If I don't specify any priority (both routers will have the same
priority), is there any kind of load balancing between routers?. Or should I do it
'handmade', specifying different priorities for different group of clients and
servers?.
I believe Lustre will round-robin requests through the lnet routers if they are the same
priority.
--
Rick Mohr
Senior HPC System Administrator
National Institute for Computational Sciences
http://www.nics.tennessee.edu
2:45 a.m.
The route selection algorithm looks at:
1. Priority
2. Hop count
3. Number of bytes in transit (or queued)
4. Number of credits available
5. Which was used last
So, everything else being equal, step 5 will ensure round-robin. But there are several
other factors that are considered first.
Chris Horn
On Jul 30, 2015, at 11:23 AM, Mohr Jr, Richard Frank (Rick Mohr)
<rmohr(a)utk.edu> wrote:
> On Jul 30, 2015, at 3:12 AM, Jose Manuel Martínez <jose.martinez(a)fcsc.es>
wrote:
>
>
> My question: If I don't specify any priority (both routers will have the same
priority), is there any kind of load balancing between routers?. Or should I do it
'handmade', specifying different priorities for different group of clients and
servers?.
I believe Lustre will round-robin requests through the lnet routers if they are the same
priority.
--
Rick Mohr
Senior HPC System Administrator
National Institute for Computational Sciences
http://www.nics.tennessee.edu
_______________________________________________
HPDD-discuss mailing list
HPDD-discuss(a)lists.01.org
https://lists.01.org/mailman/listinfo/hpdd-discuss
6:22 a.m.
Thank you so much for the answers.
So, using many routers to join the same subnets, we can ensure some kind of HA (the
clients check if routers are up and can select an online one and avoid getting isolated)
and also some kind of load balancing.
I'm been working with Lustre for sometime but never used routers before. They are
really powerful.
Best regards.
JoseM
________________________________________
De: Chris Horn [hornc(a)cray.com]
Enviado el: jueves, 30 de julio de 2015 18:45
Para: Mohr Jr, Richard Frank (Rick Mohr)
CC: Jose Manuel Martínez García; HPDD-discuss(a)lists.01.org
Asunto: Re: [HPDD-discuss] Load balancing between routers
The route selection algorithm looks at:
1. Priority
2. Hop count
3. Number of bytes in transit (or queued)
4. Number of credits available
5. Which was used last
So, everything else being equal, step 5 will ensure round-robin. But there are several
other factors that are considered first.
Chris Horn
On Jul 30, 2015, at 11:23 AM, Mohr Jr, Richard Frank (Rick Mohr)
<rmohr(a)utk.edu> wrote:
> On Jul 30, 2015, at 3:12 AM, Jose Manuel Martínez <jose.martinez(a)fcsc.es>
wrote:
>
>
> My question: If I don't specify any priority (both routers will have the same
priority), is there any kind of load balancing between routers?. Or should I do it
'handmade', specifying different priorities for different group of clients and
servers?.
I believe Lustre will round-robin requests through the lnet routers if they are the same
priority.
--
Rick Mohr
Senior HPC System Administrator
National Institute for Computational Sciences
http://www.nics.tennessee.edu
_______________________________________________
HPDD-discuss mailing list
HPDD-discuss(a)lists.01.org
https://lists.01.org/mailman/listinfo/hpdd-discuss
4:44 a.m.
I'd like to add I recommend this presentation from John Fragalla -
http://cdn.opensfs.org/wp-content/uploads/2015/04/Lustre-Network-Router-C...
Lustre routers are not particularly well documented, this looks at
settings for round robin vs weighted carefully.
Scott
On 7/30/2015 2:12 AM, Jose Manuel Martínez wrote:
Hello everybody.
I'm configuring two servers as lustre routers (Lustre 2.7) in order to
join TCP and IB networks. The documentation says that many routes can be
configured for LNET with or without priorities.
My question: If I don't specify any priority (both routers will have the
same priority), is there any kind of load balancing between routers?. Or
should I do it 'handmade', specifying different priorities for different
group of clients and servers?.
Thank you everybody.
--
*Jose Manuel Martínez García / Tel. 987 293 174 *
*Coordinador de Sistemas*
Fundación Centro de Supercomputación de Castilla y León
Edificio CRAI-TIC, Campus de Vegazana, s/n
Universidad de León
24071 León, España
www.fcsc.es
logoFCSCL jcyl
_________________________________
Este correo va dirigido, de manera exclusiva, a su destinatario y puede
contener información confidencial, cuya divulgación no está permitida
por la ley. Si usted no es su destinatario notifíquelo urgentemente al
remitente y borre este correo de su sistema.
Proteja el Medio Ambiente. Evite imprimir este mensaje si no es
estrictamente necesario.
_______________________________________________
HPDD-discuss mailing list
HPDD-discuss(a)lists.01.org
https://lists.01.org/mailman/listinfo/hpdd-discuss
2606
days inactive
2607
days old
4 comments
5 participants
participants (5)
-
Chris Horn -
Jose Manuel Martínez -
Jose Manuel Martínez García
-
Mohr Jr, Richard Frank (Rick Mohr) -
Scott Nolin