[Crowbar] Instances wont get pass build

Gregory_Althaus at Dell.com Gregory_Althaus at Dell.com
Wed Jan 11 12:02:31 CST 2012


Not that I know of.  Sorry.  It is intended as a onetime thing.  You could try and reboot the instance and see if that does it.

Thanks,
Greg

From: i3D.net - Tristan van Bokkem [mailto:tristanvanbokkem at i3d.nl]
Sent: Wednesday, January 11, 2012 11:57 AM
To: Althaus, Gregory; csanburn at redwoodit.com; crowbar
Subject: RE: [Crowbar] Instances wont get pass build

I am running 1.2 Final (Version v1.2-openstack-0-gc54112d-dev) do I need to update anything?

Ping is working now, great and thx. Regarding the key, is it possible to edit an instance and inject the key afterwards?

Best regards,

Tristan van Bokkem
Datacenter Operations

Contact:
E-mail Personal: tristanvanbokkem at i3d.net<mailto:tristanvanbokkem at i3d.net>
E-mail Support: info at i3d.net<mailto:info at i3d.net>
E-mail NOC: noc at i3d.net<mailto:noc at i3d.net>
Website: http://www.i3d.net Office:
Interactive 3D B.V.
Meent 93b
3011 JG Rotterdam
The Netherlands

Visit www.smartdc.net<http://www.smartdc.net> – SmartDC is our in-house 36,000 sq. ft. datacenter in Rotterdam, The Netherlands. High density hosting – multiple fiber carriers in-house – Level3 PoP.

Interactive 3D (i3D.net) is a company registered in The Netherlands at Meent 93b, Rotterdam. Registration #: 14074337 - VAT # NL 8202.63.886.B01. Interactive 3D (i3D.net) is CDSA certified on content protection and security. We are ranked in the Deloitte Technology Fast 50 as one of the fastest growing technology companies.
________________________________
From: Gregory_Althaus at Dell.com
To: tristanvanbokkem at i3d.nl, csanburn at redwoodit.com, crowbar at lists.us.dell.com
Sent: Wed, 11 Jan 2012 18:47:11 +0100
Subject: RE: [Crowbar] Instances wont get pass build
We think the broker issues are addressed by some recent changes to the crowbar rabbitmq cookbook and the nova cookbook.  These are in the 1.2 Crowbar Release notes wiki page.  Rabbitmq is being restarted a lot and it is causing intermittent failures because of lack of queue availability.

The key is only need to if you wish to ssh into your system.  Ping should work assuming you updated the default security group to include icmp -1 0.0.0.0/0.

Thanks,
Greg

From: i3D.net - Tristan van Bokkem [mailto:tristanvanbokkem at i3d.nl<mailto:tristanvanbokkem at i3d.nl>]
Sent: Wednesday, January 11, 2012 11:41 AM
To: i3D.net - Tristan van Bokkem; Althaus, Gregory; csanburn at redwoodit.com<mailto:csanburn at redwoodit.com>; crowbar
Subject: Re: [Crowbar] Instances wont get pass build

Another thing I noticed. Launching another instance which got deployed on another compute node trigger some errors and the instance wont get active:

from the nova-compute log:

2012-01-11 12:16:14,951 INFO nova.compute.manager [-] Updating host status
2012-01-11 12:16:57,904 DEBUG nova.rpc [-] received {u'_context_roles': [u'Admin', u'Admin', u'Admin'], u'_context_request_id': u'98d4fb61-984f-4ddc-bd29-d82963e439a1', u'_context_read_deleted': False, u'arg$
2012-01-11 12:16:57,905 DEBUG nova.rpc [-] unpacked context: {'user_id': u'admin', 'roles': [u'Admin', u'Admin', u'Admin'], 'timestamp': u'2012-01-11T18:16:54.920685', 'auth_token': u'080890769356', 'msg_id'$
2012-01-11 12:16:59,155 DEBUG nova.compute.manager [-] image_id=3, image_size_bytes=1476395008, allowed_size_bytes=85899345920 from (pid=2427) _check_image_size /usr/lib/pymodules/python2.6/nova/compute/mana$
2012-01-11 12:16:59,156 AUDIT nova.compute.manager [98d4fb61-984f-4ddc-bd29-d82963e439a1 admin 1] instance 6: starting...
2012-01-11 12:16:59,243 DEBUG nova.rpc [-] Making asynchronous call on network ... from (pid=2427) multicall /usr/lib/pymodules/python2.6/nova/rpc/impl_kombu.py:721
2012-01-11 12:16:59,244 DEBUG nova.rpc [-] MSG_ID is 3c243353b64e4499ad221a516889ed31 from (pid=2427) multicall /usr/lib/pymodules/python2.6/nova/rpc/impl_kombu.py:724
2012-01-11 12:16:59,249 ERROR nova.exception [-] Uncaught exception
(nova.exception): TRACE: Traceback (most recent call last):
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/exception.py", line 98, in wrapped
(nova.exception): TRACE:     return f(*args, **kw)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/compute/manager.py", line 480, in run_instance
(nova.exception): TRACE:     self._run_instance(context, instance_id, **kwargs)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/compute/manager.py", line 421, in _run_instance
(nova.exception): TRACE:     network_info = _make_network_info()
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/compute/manager.py", line 377, in _make_network_info
(nova.exception): TRACE:     requested_networks=requested_networks)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/network/api.py", line 162, in allocate_for_instance
(nova.exception): TRACE:     'args': args})
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/rpc/__init__.py", line 45, in call
(nova.exception): TRACE:     return get_impl().call(context, topic, msg)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/rpc/impl_kombu.py", line 737, in call
(nova.exception): TRACE:     rv = multicall(context, topic, msg)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/rpc/impl_kombu.py", line 729, in multicall
(nova.exception): TRACE:     conn.declare_direct_consumer(msg_id, wait_msg)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/rpc/impl_kombu.py", line 449, in declare_direct_consumer
(nova.exception): TRACE:     self.declare_consumer(DirectConsumer, topic, callback)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/rpc/impl_kombu.py", line 394, in declare_consumer
(nova.exception): TRACE:     self.consumer_num.next())
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/rpc/impl_kombu.py", line 140, in __init__
(nova.exception): TRACE:     **options)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/rpc/impl_kombu.py", line 61, in __init__
(nova.exception): TRACE:     self.reconnect(channel)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/nova/rpc/impl_kombu.py", line 68, in reconnect
(nova.exception): TRACE:     self.queue.declare()
(nova.exception): TRACE:   File "/usr/lib/python2.6/dist-packages/kombu/entity.py", line 359, in declare
(nova.exception): TRACE:     return (self.name and self.exchange.declare(nowait),
(nova.exception): TRACE:   File "/usr/lib/python2.6/dist-packages/kombu/entity.py", line 151, in declare
(nova.exception): TRACE:     nowait=nowait)
(nova.exception): TRACE:   File "/usr/lib/python2.6/dist-packages/kombu/syn.py", line 14, in blocking
(nova.exception): TRACE:     return __sync_current(fun, *args, **kwargs)
(nova.exception): TRACE:   File "/usr/lib/python2.6/dist-packages/kombu/syn.py", line 40, in __eblocking__
(nova.exception): TRACE:     return spawn(fun, *args, **kwargs).wait()
(nova.exception): TRACE:   File "/usr/lib/python2.6/dist-packages/eventlet/greenthread.py", line 166, in wait
(nova.exception): TRACE:     return self._exit_event.wait()
(nova.exception): TRACE:   File "/usr/lib/python2.6/dist-packages/eventlet/event.py", line 116, in wait
(nova.exception): TRACE:     return hubs.get_hub().switch()
(nova.exception): TRACE:   File "/usr/lib/python2.6/dist-packages/eventlet/hubs/hub.py", line 177, in switch
(nova.exception): TRACE:     return self.greenlet.switch()
(nova.exception): TRACE:   File "/usr/lib/python2.6/dist-packages/eventlet/greenthread.py", line 192, in main
(nova.exception): TRACE:     result = function(*args, **kwargs)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/amqplib/client_0_8/channel.py", line 843, in exchange_declare
(nova.exception): TRACE:     (40, 11),    # Channel.exchange_declare_ok
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/amqplib/client_0_8/abstract_channel.py", line 89, in wait
(nova.exception): TRACE:     self.channel_id, allowed_methods)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/amqplib/client_0_8/connection.py", line 218, in _wait_method
(nova.exception): TRACE:     self.wait()
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/amqplib/client_0_8/abstract_channel.py", line 105, in wait
(nova.exception): TRACE:     return amqp_method(self, args)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.6/amqplib/client_0_8/connection.py", line 367, in _close
(nova.exception): TRACE:     raise AMQPConnectionException(reply_code, reply_text, (class_id, method_id))
(nova.exception): TRACE: AMQPConnectionException: (320, u"CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'", (0, 0), '')
(nova.exception): TRACE:
2012-01-11 12:16:59,254 ERROR nova.rpc [-] Exception during message handling
(nova.rpc): TRACE: Traceback (most recent call last):
(nova.rpc): TRACE:   File "/usr/lib/pymodules/python2.6/nova/rpc/impl_kombu.py", line 620, in _process_data
(nova.rpc): TRACE:     rval = node_func(context=ctxt, **node_args)
(nova.rpc): TRACE:   File "/usr/lib/pymodules/python2.6/nova/exception.py", line 129, in wrapped
(nova.rpc): TRACE:     raise Error(str(e))
(nova.rpc): TRACE: Error: (320, u"CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'", (0, 0), '')
(nova.rpc): TRACE:
2012-01-11 12:17:17,168 INFO nova.compute.manager [-] Found 1 in the database and 0 on the hypervisor.
2012-01-11 12:18:17,169 INFO nova.compute.manager [-] Updating host status


and the nova-network log:

2012-01-11 12:28:22,475 ERROR nova.rpc [-] Failed to consume message from queue: (320, u"CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'", (0, 0), '')
(nova.rpc): TRACE: Traceback (most recent call last):
(nova.rpc): TRACE:   File "/usr/lib/pymodules/python2.6/nova/rpc/impl_kombu.py", line 411, in iterconsume
(nova.rpc): TRACE:     yield self.connection.drain_events()
(nova.rpc): TRACE:   File "/usr/lib/python2.6/dist-packages/kombu/connection.py", line 110, in drain_events
(nova.rpc): TRACE:     return self.transport.drain_events(self.connection, **kwargs)
(nova.rpc): TRACE:   File "/usr/lib/python2.6/dist-packages/kombu/transport/pyamqplib.py", line 200, in drain_events
(nova.rpc): TRACE:     return connection.drain_events(**kwargs)
(nova.rpc): TRACE:   File "/usr/lib/python2.6/dist-packages/kombu/transport/pyamqplib.py", line 50, in drain_events
(nova.rpc): TRACE:     return self.wait_multi(self.channels.values(), timeout=timeout)
(nova.rpc): TRACE:   File "/usr/lib/python2.6/dist-packages/kombu/transport/pyamqplib.py", line 75, in wait_multi
(nova.rpc): TRACE:     return amqp_method(channel, args)
(nova.rpc): TRACE:   File "/usr/lib/pymodules/python2.6/amqplib/client_0_8/connection.py", line 367, in _close
(nova.rpc): TRACE:     raise AMQPConnectionException(reply_code, reply_text, (class_id, method_id))
(nova.rpc): TRACE: AMQPConnectionException: (320, u"CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'", (0, 0), '')
(nova.rpc): TRACE:
2012-01-11 12:28:23,479 ERROR nova.rpc [-] AMQP server on 192.168.124.81:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
2012-01-11 12:28:24,481 ERROR nova.rpc [-] AMQP server on 192.168.124.81:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.
2012-01-11 12:28:27,536 INFO nova.rpc [-] Connected to AMQP server on 192.168.124.81:5672
2012-01-11 12:28:27,552 DEBUG nova.rpc [-] Re-established AMQP queues from (pid=4483) reconnect /usr/lib/pymodules/python2.6/nova/rpc/impl_kombu.py:358


Best regards,

Tristan van Bokkem
Datacenter Operations

Contact:
E-mail Personal: tristanvanbokkem at i3d.net<mailto:tristanvanbokkem at i3d.net>
E-mail Support: info at i3d.net<mailto:info at i3d.net>
E-mail NOC: noc at i3d.net<mailto:noc at i3d.net>
Website: http://www.i3d.net Office:
Interactive 3D B.V.
Meent 93b
3011 JG Rotterdam
The Netherlands

Visit www.smartdc.net<http://www.smartdc.net> – SmartDC is our in-house 36,000 sq. ft. datacenter in Rotterdam, The Netherlands. High density hosting – multiple fiber carriers in-house – Level3 PoP.

Interactive 3D (i3D.net) is a company registered in The Netherlands at Meent 93b, Rotterdam. Registration #: 14074337 - VAT # NL 8202.63.886.B01. Interactive 3D (i3D.net) is CDSA certified on content protection and security. We are ranked in the Deloitte Technology Fast 50 as one of the fastest growing technology companies.
________________________________
From: i3D.net - Tristan van Bokkem [mailto:tristanvanbokkem at i3d.nl<mailto:tristanvanbokkem at i3d.nl>]
To: Gregory_Althaus at Dell.com<mailto:Gregory_Althaus at Dell.com>, csanburn at redwoodit.com<mailto:csanburn at redwoodit.com>, crowbar at lists.us.dell.com<mailto:crowbar at lists.us.dell.com>
Sent: Wed, 11 Jan 2012 18:34:07 +0100
Subject: Re: [Crowbar] Instances wont get pass build

Right, I am trying to ping / ssh it from the crowbar node. No success yet. I build the instance plain default with the 'm1.small' template. No key name selected <- is this needed?

Best regards,

Tristan van Bokkem
Datacenter Operations

Contact:
E-mail Personal: tristanvanbokkem at i3d.net<mailto:tristanvanbokkem at i3d.net>
E-mail Support: info at i3d.net<mailto:info at i3d.net>
E-mail NOC: noc at i3d.net<mailto:noc at i3d.net>
Website: http://www.i3d.net Office:
Interactive 3D B.V.
Meent 93b
3011 JG Rotterdam
The Netherlands

Visit www.smartdc.net<http://www.smartdc.net> – SmartDC is our in-house 36,000 sq. ft. datacenter in Rotterdam, The Netherlands. High density hosting – multiple fiber carriers in-house – Level3 PoP.

Interactive 3D (i3D.net) is a company registered in The Netherlands at Meent 93b, Rotterdam. Registration #: 14074337 - VAT # NL 8202.63.886.B01. Interactive 3D (i3D.net) is CDSA certified on content protection and security. We are ranked in the Deloitte Technology Fast 50 as one of the fastest growing technology companies.
________________________________
From: Gregory_Althaus at Dell.com<mailto:Gregory_Althaus at Dell.com>
To: tristanvanbokkem at i3d.nl<mailto:tristanvanbokkem at i3d.nl>, csanburn at redwoodit.com<mailto:csanburn at redwoodit.com>, crowbar at lists.us.dell.com<mailto:crowbar at lists.us.dell.com>
Sent: Wed, 11 Jan 2012 18:27:06 +0100
Subject: RE: [Crowbar] Instances wont get pass build
The first one can take some time to spin because the image has to be copied to that compute node from glance, but that is measured in a couple of minutes at most.

The next thing is to check your security groups and what default access you have created.
Also, check where you are accessing the node from.

The NAT rules are pretty restrictive by default.

Thanks,
Greg

From: crowbar-bounces On Behalf Of i3D.net - Tristan van Bokkem
Sent: Wednesday, January 11, 2012 11:25 AM
To: Althaus, Gregory; csanburn at redwoodit.com<mailto:csanburn at redwoodit.com>; crowbar
Subject: Re: [Crowbar] Instances wont get pass build

I assumed it was, it always has been. Turned out it wasn't on my test nodes :(
I finally created an instance which is active now. But I am unable to access it yet?

Best regards,

Tristan van Bokkem
Datacenter Operations

Contact:
E-mail Personal: tristanvanbokkem at i3d.net<mailto:tristanvanbokkem at i3d.net>
E-mail Support: info at i3d.net<mailto:info at i3d.net>
E-mail NOC: noc at i3d.net<mailto:noc at i3d.net>
Website: http://www.i3d.net Office:
Interactive 3D B.V.
Meent 93b
3011 JG Rotterdam
The Netherlands

Visit www.smartdc.net<http://www.smartdc.net> – SmartDC is our in-house 36,000 sq. ft. datacenter in Rotterdam, The Netherlands. High density hosting – multiple fiber carriers in-house – Level3 PoP.

Interactive 3D (i3D.net) is a company registered in The Netherlands at Meent 93b, Rotterdam. Registration #: 14074337 - VAT # NL 8202.63.886.B01. Interactive 3D (i3D.net) is CDSA certified on content protection and security. We are ranked in the Deloitte Technology Fast 50 as one of the fastest growing technology companies.
________________________________
From: Gregory_Althaus at Dell.com<mailto:Gregory_Althaus at Dell.com>
To: tristanvanbokkem at i3d.nl<mailto:tristanvanbokkem at i3d.nl>, csanburn at redwoodit.com<mailto:csanburn at redwoodit.com>, crowbar at lists.us.dell.com<mailto:crowbar at lists.us.dell.com>
Sent: Wed, 11 Jan 2012 18:18:08 +0100
Subject: RE: [Crowbar] Instances wont get pass build
Check on that node to make sure that hardware virtualization is there and enabled.  We’ve seen this if the Intel-VT or AMD specific flag isn’t turned on.

Thanks,
Greg

From: crowbar-bounces On Behalf Of i3D.net - Tristan van Bokkem
Sent: Wednesday, January 11, 2012 10:22 AM
To: Chris Sanburn; crowbar
Subject: Re: [Crowbar] Instances wont get pass build

nova-network seems to be running. Upon looking at the nova-compute log I noticed this:

2012-01-11 11:03:58,826 ERROR nova.compute.manager [-] Instance '2' failed to spawn. Is virtualization enabled in the BIOS? Details: internal error no supported architecture for os type 'hvm'

Upon checking the proposal of Nova: libvirt_type:    kvm

So what is hvm?

Best regards,

Tristan van Bokkem
Datacenter Operations

Contact:
E-mail Personal: tristanvanbokkem at i3d.net<mailto:tristanvanbokkem at i3d.net>
E-mail Support: info at i3d.net<mailto:info at i3d.net>
E-mail NOC: noc at i3d.net<mailto:noc at i3d.net>
Website: http://www.i3d.net Office:
Interactive 3D B.V.
Meent 93b
3011 JG Rotterdam
The Netherlands

Visit www.smartdc.net<http://www.smartdc.net> – SmartDC is our in-house 36,000 sq. ft. datacenter in Rotterdam, The Netherlands. High density hosting – multiple fiber carriers in-house – Level3 PoP.

Interactive 3D (i3D.net) is a company registered in The Netherlands at Meent 93b, Rotterdam. Registration #: 14074337 - VAT # NL 8202.63.886.B01. Interactive 3D (i3D.net) is CDSA certified on content protection and security. We are ranked in the Deloitte Technology Fast 50 as one of the fastest growing technology companies.
________________________________
From: Chris Sanburn [mailto:csanburn at redwoodit.com<mailto:csanburn at redwoodit.com>]
To: crowbar at lists.us.dell.com<mailto:crowbar at lists.us.dell.com> [mailto:crowbar at lists.us.dell.com<mailto:crowbar at lists.us.dell.com>]
Sent: Wed, 11 Jan 2012 17:09:07 +0100
Subject: Re: [Crowbar] Instances wont get pass build
In my case, when the instances got stuck in build status, I found that my nova-network wasn’t running. When I went to the service dashboard and checked the instance I found it was never assigned an IP address. From that same screen I noted the node it was deployed on, went there and checked items in /var/log/nova and it appeared to be failing to get an IP address. When I did “service nova-network status†I found it not running. So I ran “service nova-network startâ€, removed the instance, launched a new one and it completed.
I was using Nagios to determine if all my services were running and the version I’m currently on doesn’t have a service check for nova-network, or if it did then it wasn’t working.

-Chris

From: crowbar-bounces at dell.com<mailto:crowbar-bounces at dell.com> [mailto:crowbar-bounces at dell.com<mailto:crowbar-bounces at dell.com>] On Behalf Of i3D.net - Tristan van Bokkem
Sent: Wednesday, January 11, 2012 10:48 AM
To: Gregory_Althaus at Dell.com<mailto:Gregory_Althaus at Dell.com>; crowbar at lists.us.dell.com<mailto:crowbar at lists.us.dell.com>
Subject: Re: [Crowbar] Instances wont get pass build

Aha, alright. nova-schedular is there and its green. I have restarted it anyway but I dont see any changes.

Best regards,

Tristan van Bokkem
Datacenter Operations

Contact:
E-mail Personal: tristanvanbokkem at i3d.net<mailto:tristanvanbokkem at i3d.net>
E-mail Support: info at i3d.net<mailto:info at i3d.net>
E-mail NOC: noc at i3d.net<mailto:noc at i3d.net>
Website: http://www.i3d.net Office:
Interactive 3D B.V.
Meent 93b
3011 JG Rotterdam
The Netherlands

Visit www.smartdc.net<http://www.smartdc.net> – SmartDC is our in-house 36,000 sq. ft. datacenter in Rotterdam, The Netherlands. High density hosting – multiple fiber carriers in-house – Level3 PoP.

Interactive 3D (i3D.net) is a company registered in The Netherlands at Meent 93b, Rotterdam. Registration #: 14074337 - VAT # NL 8202.63.886.B01. Interactive 3D (i3D.net) is CDSA certified on content protection and security. We are ranked in the Deloitte Technology Fast 50 as one of the fastest growing technology companies.
________________________________
From: Gregory_Althaus at Dell.com<mailto:Gregory_Althaus at Dell.com>
To: tristanvanbokkem at i3d.nl<mailto:tristanvanbokkem at i3d.nl>, crowbar at lists.us.dell.com<mailto:crowbar at lists.us.dell.com>
Sent: Wed, 11 Jan 2012 16:40:39 +0100
Subject: RE: [Crowbar] Instances wont get pass build
Object store is swift (in the dashboard).  So if it is down, that is okay.

Check for nova-scheduler in the services list.  If it is not there, go to the controller node and issue, /etc/init.d/nova-scheduler restart.  We’ve seen some cases where this doesn’t happen always.

Thanks,
Greg

From: crowbar-bounces On Behalf Of i3D.net - Tristan van Bokkem
Sent: Wednesday, January 11, 2012 9:39 AM
To: crowbar
Subject: [Crowbar] Instances wont get pass build

Hi,

Besides the issue of being unable to deploy swift I am also facing a issue of deploying instances (without swift). I made a test instance within dashboard and the status is set to 'Build'. It never changes to complete. I noticed the object-store service is red instead of green as every other service. What is wrong here?

Best regards,

Tristan van Bokkem
Datacenter Operations

Contact:
E-mail Personal: tristanvanbokkem at i3d.net<mailto:tristanvanbokkem at i3d.net>
E-mail Support: info at i3d.net<mailto:info at i3d.net>
E-mail NOC: noc at i3d.net<mailto:noc at i3d.net>
Website: http://www.i3d.net Office:
Interactive 3D B.V.
Meent 93b
3011 JG Rotterdam
The Netherlands

Visit www.smartdc.net<http://www.smartdc.net> – SmartDC is our in-house 36,000 sq. ft. datacenter in Rotterdam, The Netherlands. High density hosting – multiple fiber carriers in-house – Level3 PoP.

Interactive 3D (i3D.net) is a company registered in The Netherlands at Meent 93b, Rotterdam. Registration #: 14074337 - VAT # NL 8202.63.886.B01. Interactive 3D (i3D.net) is CDSA certified on content protection and security. We are ranked in the Deloitte Technology Fast 50 as one of the fastest growing technology companies.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.us.dell.com/pipermail/crowbar/attachments/20120111/cf8d6634/attachment-0001.html 


More information about the Crowbar mailing list