login
Header Space

 
 

Re: [ofa-general] Problem running SDP apps using OFED 1.2

Score:
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Scott Weitzenkamp (sweitzen) <sweitzen@...>
Cc: <general@...>
Date: Friday, October 5, 2007 - 7:25 pm

------=_Part_13764_7924086.1191626722839
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

I restarted openibd and now my interfaces are up.

mach#1
ib0       Link encap:InfiniBand  HWaddr
80:00:00:02:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00
          inet addr:140.221.37.46  Bcast:140.221.37.255  Mask:255.255.255.0
          inet6 addr: fe80::211:7500:ff:d7f2/64 Scope:Link

mach#2
ib0       Link encap:InfiniBand  HWaddr
80:00:00:03:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00
          inet addr:140.221.37.32  Bcast:140.221.37.255  Mask:255.255.255.0
          inet6 addr: fe80::211:7500:ff:d802/64 Scope:Link

I am able to "ping 140.221.37.46" from machine#2.

mach#2 > ping 140.221.37.46
PING 140.221.37.46 (140.221.37.46) 56(84) bytes of data.
64 bytes from 140.221.37.46: icmp_seq=1 ttl=64 time=2.49 ms
64 bytes from 140.221.37.46: icmp_seq=2 ttl=64 time=0.106 ms
64 bytes from 140.221.37.46: icmp_seq=3 ttl=64 time=0.098 ms
--- 140.221.37.46 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 0.098/0.900/2.498/1.130 ms

But sockets over SDP still gives me the same "Network Unreachable error".

--- 140.221.37.46 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 0.098/0.900/2.498/1.130 ms


On 10/5/07, Scott Weitzenkamp (sweitzen) <sweitzen@cisco.com> wrote:


-- 
Regs,
Zulfi

------=_Part_13764_7924086.1191626722839
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

I restarted openibd and now my interfaces are up.<br><br>mach#1<br>ib0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Link encap:InfiniBand&nbsp; HWaddr 80:00:00:02:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet addr:<a href="http://140.221.37.46">140.221.37.46
</a>&nbsp; Bcast:<a href="http://140.221.37.255">140.221.37.255</a>&nbsp; Mask:<a href="http://255.255.255.0">255.255.255.0</a><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet6 addr: fe80::211:7500:ff:d7f2/64 Scope:Link<br><br>mach#2<br>ib0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Link encap:InfiniBand&nbsp; HWaddr 80:00:00:03:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00
<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet addr:<a href="http://140.221.37.32">140.221.37.32</a>&nbsp; Bcast:<a href="http://140.221.37.255">140.221.37.255</a>&nbsp; Mask:<a href="http://255.255.255.0">255.255.255.0</a><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet6 addr: fe80::211:7500:ff:d802/64 Scope:Link
<br><br>I am able to &quot;ping <a href="http://140.221.37.46">140.221.37.46</a>&quot; from machine#2.<br><br>mach#2 &gt; ping <a href="http://140.221.37.46">140.221.37.46</a><br>PING <a href="http://140.221.37.46">140.221.37.46
</a> (<a href="http://140.221.37.46">140.221.37.46</a>) 56(84) bytes of data.<br>64 bytes from <a href="http://140.221.37.46">140.221.37.46</a>: icmp_seq=1 ttl=64 time=2.49 ms<br>64 bytes from <a href="http://140.221.37.46">
140.221.37.46</a>: icmp_seq=2 ttl=64 time=0.106 ms<br>64 bytes from <a href="http://140.221.37.46">140.221.37.46</a>: icmp_seq=3 ttl=64 time=0.098 ms<br>--- <a href="http://140.221.37.46">140.221.37.46</a> ping statistics ---
<br>3 packets transmitted, 3 received, 0% packet loss, time 2002ms<br>rtt min/avg/max/mdev = 0.098/0.900/2.498/1.130 ms<br><br>But sockets over SDP still gives me the same &quot;Network Unreachable error&quot;.<br><br>--- 
<a href="http://140.221.37.46">140.221.37.46</a> ping statistics ---<br>3 packets transmitted, 3 received, 0% packet loss, time 2002ms<br>rtt min/avg/max/mdev = 0.098/0.900/2.498/1.130 ms<br><br><br><div><span class="gmail_quote">
On 10/5/07, <b class="gmail_sendername">Scott Weitzenkamp (sweitzen)</b> &lt;<a href="mailto:sweitzen@cisco.com">sweitzen@cisco.com</a>&gt; wrote:</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">




<div>
<div dir="ltr" align="left"><span><font color="#0000ff" face="Arial" size="2">Can you ping between the two nodes using the IPoIB IP 
address?</font></span></div>
<div>&nbsp;</div>
<div align="left"><font face="Arial" size="2">Scott Weitzenkamp</font></div>
<div align="left"><font face="Arial" size="2">SQA and Release Manager</font></div>
<div align="left"><font face="Arial" size="2">Server Virtualization Business 
Unit</font></div>
<div align="left"><font face="Arial" size="2">Cisco Systems</font></div>
<div>&nbsp;</div><br>
<blockquote style="border-left: 2px solid rgb(0, 0, 255); padding-left: 5px; margin-left: 5px; margin-right: 0px;">
  <div dir="ltr" align="left" lang="en-us">
  <hr>
  <font face="Tahoma" size="2"><b>From:</b> <a href="mailto:general-bounces@lists.openfabrics.org" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">general-bounces@lists.openfabrics.org</a> 
  [mailto:<a href="mailto:general-bounces@lists.openfabrics.org" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">general-bounces@lists.openfabrics.org</a>] <b>On Behalf Of </b>Zulfi 
  Imani<br><b>Sent:</b> Friday, October 05, 2007 3:01 PM<br><b>To:</b> 
  <a href="mailto:dotanb@dev.mellanox.co.il" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">dotanb@dev.mellanox.co.il</a><br><b>Cc:</b> 
  <a href="mailto:general@lists.openfabrics.org" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">general@lists.openfabrics.org</a><br><b>Subject:</b> Re: [ofa-general] Problem 
  running SDP apps using OFED 1.2<br></font><br></div><div><span class="e" id="q_11572364c075c398_1">
  <div></div>Hi Dotan,<br><br>ifconfig shows 
  up<br><br>ib0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Link encap:InfiniBand&nbsp; 
  HWaddr 80:00:00:03:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00 
  <br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet addr: <a href="http://140.221.37.32" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">140.221.37.32</a>&nbsp; Bcast:<a href="http://140.221.37.255" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">
 140.221.37.255</a>&nbsp; Mask:<a href="http://255.255.255.0" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">255.255.255.0</a><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
  inet6 addr: fe80::211:7500:ff:d802/64 Scope:Link 
  <br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; UP BROADCAST 
  RUNNING MULTICAST&nbsp; MTU:65520&nbsp; 
  Metric:1<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; RX 
  packets:0 errors:0 dropped:0 overruns:0 
  frame:0<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; TX packets:1 
  errors:0 dropped:5 overruns:0 
  carrier:0<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
  collisions:0 txqueuelen:128 
  <br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; RX bytes:0 (0.0 
  b)&nbsp; TX bytes:68 (68.0 b)<br><br>does this mean that the apps would now 
  use IPoIB ? How do i tell when IPoIB is working and when it isnt ? Because I 
  assume when it isnt it would default to Ethernet ? <br><br>It will be great if 
  I can get this cleared.<br><br>Thanks<br>Zulfi<br><br>
  <div><span class="gmail_quote">On 9/30/07, <b class="gmail_sendername">Dotan 
  Barak</b> &lt;<a href="mailto:dotanb@dev.mellanox.co.il" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> 
  dotanb@dev.mellanox.co.il </a>&gt; wrote:</span>
  <blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">Does 
    a simple &quot;ping&quot; between the nodes is working?<br>(this way you can be sure 
    that IPoIB is working and SDP should work) <br><br>Dotan<br><br><br>Zulfi 
    Imani wrote:<br>&gt; I have not tried over IPoIB, but opensm is 
    running<br>&gt;<br>&gt; /home/zulfi &gt; sminfo<br>&gt; sminfo: sm lid 1 sm 
    guid 0x11750000ffdaf4, activity count 16220<br>&gt; priority 0 state 3 
    SMINFO_MASTER <br>&gt;<br>&gt; I also tried a few iband utilities and they 
    all work fine. Not able to<br>&gt; run any socket apps over 
    SDP.<br>&gt;<br>&gt; Thanks<br>&gt; Zulfi<br>&gt;<br>&gt; On 9/27/07, *Jim 
    Mott* &lt;<a href="mailto:jimmott@austin.rr.com" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> 
    jimmott@austin.rr.com</a><br>&gt; &lt;mailto:<a href="mailto:jimmott@austin.rr.com" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">jimmott@austin.rr.com</a>&gt;&gt; 
    wrote:<br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; Were you able to connect 
    IPoIB between the nodes?&nbsp;&nbsp;Are you sure 
    <br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; opensm was running?&nbsp;&nbsp;I am ashamed 
    to admit that occasionally I <br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; forget to 
    start opensm and wonder why SDP does not 
    connect.<br>&gt;<br>&gt;<br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; *From:* <a href="mailto:general-bounces@lists.openfabrics.org" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">general-bounces@lists.openfabrics.org
</a><br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; 
    &lt;mailto: <a href="mailto:general-bounces@lists.openfabrics.org" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">general-bounces@lists.openfabrics.org</a>&gt; 
    [mailto:<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; <a href="mailto:general-bounces@lists.openfabrics.org" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">general-bounces@lists.openfabrics.org</a><br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; 
    &lt;mailto:<a href="mailto:general-bounces@lists.openfabrics.org" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">general-bounces@lists.openfabrics.org</a>&gt;] *On Behalf 
    Of<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; *Zulfi Imani 
    <br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; *Sent:* Thursday, September 27, 2007 3:22 
    PM<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; *To:* <a href="mailto:general@lists.openfabrics.org" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">general@lists.openfabrics.org</a><br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; 
    &lt;mailto:<a href="mailto:general@lists.openfabrics.org" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> 
    general@lists.openfabrics.org</a>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; 
    *Subject:* [ofa-general] Problem running SDP apps using OFED 
    1.2<br>&gt;<br>&gt;<br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; 
    Hi,<br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; I installed the OFED1.2 stack 
    and am trying to run a simple socket<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; server 
    and client over the SDP stack. The Infiniband hardware 
    is<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; QLogic. 
    <br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; First I set the ENV 
    vars<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; export 
    LD_PRELOAD=/root/zulfi/iband/INSTALL/lib64/libsdp.so<br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; 
    export 
    LIBSDP_CONFIG_FILE=/home/zulfi/libsdp.conf<br>&gt;<br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; 
    The SDP config file has: <br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; *use sdp server * 
    *:*<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; use sdp client * 
    *:*<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; *<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; Then 
    started the socket server and did a &#39;sdpnetstat -San&#39; 
    and<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; found that it listed the SDP port on 
    which the server was listening. <br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; On 
    the client machine too I did the same; exported the 
    variables,<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; setup the SDP config file and on 
    running the client &#39;./client<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; port# 
    server_machine&#39; it gave me a &quot;network not reachable&quot; error. 
    <br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; I tried to get some information 
    about the error on the net but<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; could not 
    find any.<br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; I then checked the 
    /proc/&lt;pid&gt;/maps file and found that 
    libsdp.so<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; was being loaded. 
    <br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; also:<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; /root 
    &gt; lsmod | grep sdp<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; 
    ib_sdp&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;120224&nbsp;&nbsp;3<br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; 
    Does QLogic support SDP applications ? Or am I missing 
    something<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; in the SDP config file or do I 
    need to make changes to my code ? <br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; 
    Any information on this will be a big 
    help.<br>&gt;<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; 
    Thanks,<br>&gt;&nbsp;&nbsp;&nbsp;&nbsp; 
    Zulfi<br>&gt;<br>&gt;<br>&gt;<br>&gt;<br>&gt;<br>&gt;<br>&gt; --<br>&gt; 
    Regs,<br>&gt; Zulfi<br>&gt; 
    ------------------------------------------------------------------------ 
    <br>&gt;<br>&gt; _______________________________________________<br>&gt; 
    general mailing list<br>&gt; <a href="mailto:general@lists.openfabrics.org" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">general@lists.openfabrics.org</a><br>&gt; <a href="http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general</a><br>&gt;<br>&gt; 
    To unsubscribe, please visit <a href="http://openib.org/mailman/listinfo/openib-general" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">http://openib.org/mailman/listinfo/openib-general</a> 
  <br><br></blockquote></div><br><br clear="all"><br>-- <br>Regs,<br>Zulfi 
</span></div></blockquote></div>
</blockquote></div><br><br clear="all"><br>-- <br>Regs,<br>Zulfi

------=_Part_13764_7924086.1191626722839--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[ofa-general] Problem running SDP apps using OFED 1.2, Zulfi Imani, (Thu Sep 27, 4:22 pm)
[ofa-general] Microsoft Office 2007 ready to download, Stacy Riddle, (Wed Dec 31, 8:00 pm)
RE: [ofa-general] Problem running SDP apps using OFED 1.2, Scott Weitzenkamp (sweitzen)..., (Fri Oct 5, 6:08 pm)
Re: [ofa-general] Problem running SDP apps using OFED 1.2, Zulfi Imani, (Fri Oct 5, 7:25 pm)
RE: [ofa-general] Problem running SDP apps using OFED 1.2, Scott Weitzenkamp (sweitzen)..., (Fri Oct 5, 9:37 pm)
speck-geostationary