Re: [ofa-general] Problem running SDP apps using OFED 1.2

Previous thread: Re: [ofa-general] [PATCH v3] iw_cxgb3: Support "iwarp-only" interfaces to avoid 4-tuple conflicts. by Sean Hefty on Thursday, September 27, 2007 - 2:38 pm. (13 messages)

Next thread: [ofa-general] Save the date: OFA Developer's Summit: November 15-16 in Nevada by Johann George on Thursday, September 27, 2007 - 6:13 pm. (4 messages)
To: <general@...>
Date: Thursday, September 27, 2007 - 4:22 pm

------=_Part_3251_20128219.1190924531585
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Hi,

I installed the OFED1.2 stack and am trying to run a simple socket server
and client over the SDP stack. The Infiniband hardware is QLogic.

First I set the ENV vars
export LD_PRELOAD=/root/zulfi/iband/INSTALL/lib64/libsdp.so
export LIBSDP_CONFIG_FILE=/home/zulfi/libsdp.conf

The SDP config file has:
use sdp server * *:*
use sdp client * *:*

Then started the socket server and did a 'sdpnetstat -San' and found that it
listed the SDP port on which the server was listening.

On the client machine too I did the same; exported the variables, setup the
SDP config file and on running the client './client port# server_machine' it
gave me a "network not reachable" error.

I tried to get some information about the error on the net but could not
find any.

I then checked the /proc/<pid>/maps file and found that libsdp.so was being
loaded.
also:
/root > lsmod | grep sdp
ib_sdp 120224 3

Does QLogic support SDP applications ? Or am I missing something in the SDP
config file or do I need to make changes to my code ?

Any information on this will be a big help.

Thanks,
Zulfi

------=_Part_3251_20128219.1190924531585
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Hi,<br><br>I installed the OFED1.2 stack and am trying to run a simple
socket server and client over the SDP stack. The Infiniband hardware is
QLogic.<br><br>First I set the ENV vars<br>export LD_PRELOAD=/root/zulfi/iband/INSTALL/lib64/libsdp.so
<br><div>export LIBSDP_CONFIG_FILE=/home/zulfi/libsdp.conf<br><div><br>The SDP config file has:<span style="font-weight: bold; font-style: italic;"></span><span><br><span style="font-weight: bold;">use sdp server * *:*
</span><br style="font-weight:...

To: <openib-general@...>
Date: Wednesday, December 31, 1969 - 8:00 pm

Microsoft Office Enterprise 2007 includes:

To: 'Zulfi Imani' <zulfiimani@...>, <general@...>
Date: Thursday, September 27, 2007 - 5:11 pm

This is a multipart message in MIME format.

------=_NextPart_000_000A_01C80121.1B5FF080
Content-Type: text/plain;
charset="US-ASCII"
Content-Transfer-Encoding: 7bit

Were you able to connect IPoIB between the nodes? Are you sure opensm was running? I am ashamed to admit that occasionally I
forget to start opensm and wonder why SDP does not connect.

From: general-bounces@lists.openfabrics.org [mailto:general-bounces@lists.openfabrics.org] On Behalf Of Zulfi Imani
Sent: Thursday, September 27, 2007 3:22 PM
To: general@lists.openfabrics.org
Subject: [ofa-general] Problem running SDP apps using OFED 1.2

Hi,

I installed the OFED1.2 stack and am trying to run a simple socket server and client over the SDP stack. The Infiniband hardware is
QLogic.

First I set the ENV vars
export LD_PRELOAD=/root/zulfi/iband/INSTALL/lib64/libsdp.so

export LIBSDP_CONFIG_FILE=/home/zulfi/libsdp.conf

The SDP config file has:
use sdp server * *:*
use sdp client * *:*

Then started the socket server and did a 'sdpnetstat -San' and found that it listed the SDP port on which the server was listening.

On the client machine too I did the same; exported the variables, setup the SDP config file and on running the client './client
port# server_machine' it gave me a "network not reachable" error.

I tried to get some information about the error on the net but could not find any.

I then checked the /proc/<pid>/maps file and found that libsdp.so was being loaded.
also:
/root > lsmod | grep sdp
ib_sdp 120224 3

Does QLogic support SDP applications ? Or am I missing something in the SDP config file or do I need to make changes to my code ?

Any information on this will be a big help.

Thanks,
Zulfi

------=_NextPart_000_000A_01C80121.1B5FF080
Content-Type: text/html;
charset="US-ASCII"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xm...

To: Jim Mott <jimmott@...>
Cc: <general@...>
Date: Thursday, September 27, 2007 - 6:28 pm

------=_Part_3962_2225878.1190932086271
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

I have not tried over IPoIB, but opensm is running

/home/zulfi > sminfo
sminfo: sm lid 1 sm guid 0x11750000ffdaf4, activity count 16220 priority 0
state 3 SMINFO_MASTER

I also tried a few iband utilities and they all work fine. Not able to run
any socket apps over SDP.

Thanks
Zulfi

--
Regs,
Zulfi

------=_Part_3962_2225878.1190932086271
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

I have not tried over IPoIB, but opensm is running<br><br>/home/zulfi &gt; sminfo<br>sminfo: sm lid 1 sm guid 0x11750000ffdaf4, activity count 16220 priority 0 state 3 SMINFO_MASTER<br><br>I also tried a few iband utilities and they all work fine. Not able to run any socket apps over SDP.
<br><br>Thanks<br>Zulfi<br><br><div><span class="gmail_quote">On 9/27/07, <b class="gmail_sendername">Jim Mott</b> &lt;<a href="mailto:jimmott@austin.rr.com">jimmott@austin.rr.com</a>&gt; wrote:</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">

<div link="blue" vlink="purple" lang="EN-US">

<div>

<p><span style="font-size: 11pt; color: rgb(31, 73, 125);">Were you able to connect IPoIB between the nodes?&nbsp; Are you sure
opensm was running?&nbsp; I am ashamed to admit that occasionally I forget to start
opensm and wonder why SDP does not connect. </span></p>

<p><span style="font-size: 11pt; color: rgb(31, 73, 125);">&nbsp;</span></p>

<div style="border-style: solid none none; border-color: rgb(181, 196, 223) -moz-use-text-color -moz-use-text-color; border-width: 1pt medium medium; padding: 3pt 0in 0in;...

To: Zulfi Imani <zulfiimani@...>
Cc: <general@...>
Date: Sunday, September 30, 2007 - 2:39 am

Does a simple "ping" between the nodes is working?
(this way you can be sure that IPoIB is working and SDP should work)

Dotan

_______________________________________________
general mailing list
general@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general

To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general

To: <dotanb@...>
Cc: <general@...>
Date: Friday, October 5, 2007 - 6:01 pm

------=_Part_13547_30004409.1191621670073
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Hi Dotan,

ifconfig shows up

ib0 Link encap:InfiniBand HWaddr
80:00:00:03:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00
inet addr: 140.221.37.32 Bcast: 140.221.37.255 Mask:
255.255.255.0
inet6 addr: fe80::211:7500:ff:d802/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:65520 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:1 errors:0 dropped:5 overruns:0 carrier:0
collisions:0 txqueuelen:128
RX bytes:0 (0.0 b) TX bytes:68 (68.0 b)

does this mean that the apps would now use IPoIB ? How do i tell when IPoIB
is working and when it isnt ? Because I assume when it isnt it would default
to Ethernet ?

It will be great if I can get this cleared.

Thanks
Zulfi

--
Regs,
Zulfi

------=_Part_13547_30004409.1191621670073
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Hi Dotan,<br><br>ifconfig shows up<br><br>ib0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Link encap:InfiniBand&nbsp; HWaddr 80:00:00:03:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00
<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet addr:
<a href="http://140.221.37.32" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">140.221.37.32</a>&nbsp; Bcast:<a href="http://140.221.37.255" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">

140.221.37.255</a>&nbsp; Mask:<a href="http://255.255.255.0" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">255.255.255.0</a><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet6 addr: fe80::211:7500:ff:d802/64 Scope:Lin...

To: Zulfi Imani <zulfiimani@...>, <dotanb@...>
Cc: <general@...>
Date: Friday, October 5, 2007 - 6:08 pm

This is a multi-part message in MIME format.

------_=_NextPart_001_01C8079C.3DCD473F
Content-Type: text/plain;
charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Can you ping between the two nodes using the IPoIB IP address?
=20
Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
=20

________________________________

From: general-bounces@lists.openfabrics.org
[mailto:general-bounces@lists.openfabrics.org] On Behalf Of Zulfi Imani
Sent: Friday, October 05, 2007 3:01 PM
To: dotanb@dev.mellanox.co.il
Cc: general@lists.openfabrics.org
Subject: Re: [ofa-general] Problem running SDP apps using OFED
1.2
=09
=09
Hi Dotan,
=09
ifconfig shows up
=09
ib0 Link encap:InfiniBand HWaddr
80:00:00:03:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00=20
inet addr: 140.221.37.32 Bcast: 140.221.37.255
<http://140.221.37.255> Mask:255.255.255.0
inet6 addr: fe80::211:7500:ff:d802/64 Scope:Link=20
UP BROADCAST RUNNING MULTICAST MTU:65520 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:1 errors:0 dropped:5 overruns:0 carrier:0
collisions:0 txqueuelen:128=20
RX bytes:0 (0.0 b) TX bytes:68 (68.0 b)
=09
does this mean that the apps would now use IPoIB ? How do i tell
when IPoIB is working and when it isnt ? Because I assume when it isnt
it would default to Ethernet ?=20
=09
It will be great if I can get this cleared.
=09
Thanks
Zulfi
=09
=09
On 9/30/07, Dotan Barak < dotanb@dev.mellanox.co.il
<mailto:dotanb@dev.mellanox.co.il> > wrote:=20

Does a simple "ping" between the nodes is working?
(this way you can be sure that IPoIB is working and SDP
should work)=20
=09
Dotan
=09
=09
Zulfi Imani wrote:
> I have not tried over IPoIB, but opensm is running
>
> /home/zulfi > sminfo
> sminfo: sm lid 1 sm guid 0x11750000ffdaf4, activity
count 16220
&gt...

To: Scott Weitzenkamp (sweitzen) <sweitzen@...>
Cc: <general@...>
Date: Friday, October 5, 2007 - 7:25 pm

------=_Part_13764_7924086.1191626722839
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

I restarted openibd and now my interfaces are up.

mach#1
ib0 Link encap:InfiniBand HWaddr
80:00:00:02:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00
inet addr:140.221.37.46 Bcast:140.221.37.255 Mask:255.255.255.0
inet6 addr: fe80::211:7500:ff:d7f2/64 Scope:Link

mach#2
ib0 Link encap:InfiniBand HWaddr
80:00:00:03:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00
inet addr:140.221.37.32 Bcast:140.221.37.255 Mask:255.255.255.0
inet6 addr: fe80::211:7500:ff:d802/64 Scope:Link

I am able to "ping 140.221.37.46" from machine#2.

mach#2 > ping 140.221.37.46
PING 140.221.37.46 (140.221.37.46) 56(84) bytes of data.
64 bytes from 140.221.37.46: icmp_seq=1 ttl=64 time=2.49 ms
64 bytes from 140.221.37.46: icmp_seq=2 ttl=64 time=0.106 ms
64 bytes from 140.221.37.46: icmp_seq=3 ttl=64 time=0.098 ms
--- 140.221.37.46 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 0.098/0.900/2.498/1.130 ms

But sockets over SDP still gives me the same "Network Unreachable error".

--- 140.221.37.46 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 0.098/0.900/2.498/1.130 ms

--
Regs,
Zulfi

------=_Part_13764_7924086.1191626722839
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

I restarted openibd and now my interfaces are up.<br><br>mach#1<br>ib0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Link encap:InfiniBand&nbsp; HWaddr 80:00:00:02:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet addr:<a href="http://140.221.37.46">140.221.37.46
</a>&nbsp; Bcast:<a href="h...

To: Zulfi Imani <zulfiimani@...>
Cc: <general@...>
Date: Friday, October 5, 2007 - 9:37 pm

This is a multi-part message in MIME format.

------_=_NextPart_001_01C807B9.6764E868
Content-Type: text/plain;
charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Does "lsmod | grep sdp" report SDP is loaded on both machines?
=20
I would then use strace with the client to watch the socket system calls
happening, to make sure the client is trying to use SDP.
=20
Scott

________________________________

From: Zulfi Imani [mailto:zulfiimani@gmail.com]=20
Sent: Friday, October 05, 2007 4:25 PM
To: Scott Weitzenkamp (sweitzen)
Cc: dotanb@dev.mellanox.co.il; general@lists.openfabrics.org
Subject: Re: [ofa-general] Problem running SDP apps using OFED
1.2
=09
=09
I restarted openibd and now my interfaces are up.
=09
mach#1
ib0 Link encap:InfiniBand HWaddr
80:00:00:02:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00
inet addr:140.221.37.46 Bcast:140.221.37.255
Mask:255.255.255.0
inet6 addr: fe80::211:7500:ff:d7f2/64 Scope:Link
=09
mach#2
ib0 Link encap:InfiniBand HWaddr
80:00:00:03:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00=20
inet addr:140.221.37.32 Bcast:140.221.37.255
Mask:255.255.255.0
inet6 addr: fe80::211:7500:ff:d802/64 Scope:Link=20
=09
I am able to "ping 140.221.37.46" from machine#2.
=09
mach#2 > ping 140.221.37.46
PING 140.221.37.46 (140.221.37.46) 56(84) bytes of data.
64 bytes from 140.221.37.46: icmp_seq=3D1 ttl=3D64 time=3D2.49 ms
64 bytes from 140.221.37.46: icmp_seq=3D2 ttl=3D64 time=3D0.106 ms
64 bytes from 140.221.37.46: icmp_seq=3D3 ttl=3D64 time=3D0.098 ms
--- 140.221.37.46 ping statistics ---=20
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev =3D 0.098/0.900/2.498/1.130 ms
=09
But sockets over SDP still gives me the same "Network
Unreachable error".
=09
--- 140.221.37.46 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev =3D 0.098/0.900/2.498/1.130 ms
...

To: Scott Weitzenkamp (sweitzen) <sweitzen@...>
Cc: <general@...>
Date: Friday, October 5, 2007 - 6:26 pm

------=_Part_13612_8676690.1191623167533
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

For machine#1 my IPoIB interface is

ib0 Link encap:InfiniBand HWaddr
80:00:00:03:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00
inet addr:140.221.37.32 Bcast:140.221.37.255 Mask:255.255.255.0
inet6 addr: fe80::211:7500:ff:d802/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:65520 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:1 errors:0 dropped:5 overruns:0 carrier:0
collisions:0 txqueuelen:128
RX bytes:0 (0.0 b) TX bytes:68 (68.0 b)

For machine#2 my IPoIB interface is

ib0 Link encap:InfiniBand HWaddr
80:00:00:02:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00
inet6 addr: fe80::211:7500:ff:d7f2/64 Scope:Link
UP BROADCAST MULTICAST MTU:65520 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:1 errors:0 dropped:21 overruns:0 carrier:0
collisions:0 txqueuelen:128
RX bytes:0 (0.0 b) TX bytes:68 (68.0 b)

Can you please tell me what the IPoIB IP addresses are for these two
machines ? Also I do not know the IPv4 address for ib0 of machine#2 is not
showing up ?

--
Regs,
Zulfi

------=_Part_13612_8676690.1191623167533
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

For machine#1 my IPoIB&nbsp; interface is<br><br>ib0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Link encap:InfiniBand&nbsp; HWaddr 80:00:00:03:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <span style="font-weight: bold;">inet addr:<a href="http://140.221.37.32">
140.221.37.32</a>&nbsp; </span>Bcast:<a href="http://140.221.37.255">140.221.37.2...

To: Zulfi Imani <zulfiimani@...>
Cc: <general@...>
Date: Friday, October 5, 2007 - 6:58 pm

------=_Part_8145_19775178.1191625124041
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

ib0 on machine#2 is not running, but it seems that your bigger problem is
lack of some essential background on TCP/IP operation, where this list is
not the best place to gain it.

Or.

------=_Part_8145_19775178.1191625124041
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

On 10/6/07, <b class="gmail_sendername">Zulfi Imani</b> &lt;<a href="mailto:zulfiimani@gmail.com">zulfiimani@gmail.com</a>&gt; wrote:<div><span class="gmail_quote"></span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
For machine#1 my IPoIB&nbsp; interface is<span class="q"><br><br>ib0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Link encap:InfiniBand&nbsp; HWaddr 80:00:00:03:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <span style="font-weight: bold;">inet addr:<a href="http://140.221.37.32" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">

140.221.37.32</a>&nbsp; </span>Bcast:<a href="http://140.221.37.255" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">140.221.37.255</a>&nbsp; Mask:<a href="http://255.255.255.0" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">
255.255.255.0</a><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet6 addr: fe80::211:7500:ff:d802/64 Scope:Link<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; UP BROADCAST RUNNING MULTICAST&nbsp; MTU:65520&nbsp; Metric:1
<br>&nbsp;&am...

Previous thread: Re: [ofa-general] [PATCH v3] iw_cxgb3: Support "iwarp-only" interfaces to avoid 4-tuple conflicts. by Sean Hefty on Thursday, September 27, 2007 - 2:38 pm. (13 messages)

Next thread: [ofa-general] Save the date: OFA Developer's Summit: November 15-16 in Nevada by Johann George on Thursday, September 27, 2007 - 6:13 pm. (4 messages)