[Crowbar] Errors building a Crowbar CentOS-5.7 ISO

Dave Hodgson davhodg at hotmail.com
Mon Jan 9 18:07:26 CST 2012


Thanks Victor and Jord

I will give it a try

Thanks
Dave

On Jan 9, 2012, at 5:39 PM, Victor_Lowther at Dell.com wrote:

> I have just checked code into the main Crowbar repos that teach the build system how to call out to a barclamp-specified shell script, and the ganglia barclamp had been updated to use this functionality to create the ganglia .rpm files we need for RHEL/CentOS 5 builds.  It builds everything based off the FC15 src.rpm file for Ganglia, and it passes my automated admin node build.
> 
> Right now the process is very hacky, poorly documented, and WorksForMe (tm) -- I welcome feedback on what needs to be improved and genericized.
> 
> --
> Victor Lowther
> Dell CloudEdge Solutions
> Continuous Integration and Build Automation Czar
> 
> 
> From: crowbar-bounces On Behalf Of Dave Hodgson
> Sent: Sunday, January 08, 2012 7:09 PM
> To: crowbar; jord at terapeak.com
> Subject: [Crowbar] Errors building a Crowbar CentOS-5.7 ISO
> 
> Hi Jord
> 
> Thank you very much for the guidance on rolling my own Ganglia RPM's, your advice worked perfectly.
> 
> I am still struggling to get the admin node installed. I can't get past the glibc version issues. I have tried to force them to install, downloaded them to the local package dir, and chasing the dependencies, but I cant get around the version conflicts with the x64 and the dependencies. Can you give some more guidance on how you got past this?
> 
> thank you very much for your help.
> 
> thanks
> Dave Hodgson
>> From: crowbar-request at dell.com
>> Subject: Crowbar Digest, Vol 7, Issue 2
>> To: crowbar at dell.com
>> Date: Wed, 4 Jan 2012 07:25:50 -0600
>> 
>> Send Crowbar mailing list submissions to
>> crowbar at dell.com<mailto:crowbar at dell.com>
>> 
>> To subscribe or unsubscribe via the World Wide Web, visit
>> https://lists.us.dell.com/mailman/listinfo/crowbar
>> or, via email, send a message with subject or body 'help' to
>> crowbar-request at dell.com<mailto:crowbar-request at dell.com>
>> 
>> You can reach the person managing the list at
>> crowbar-owner at dell.com<mailto:crowbar-owner at dell.com>
>> 
>> When replying, please edit your Subject line so it is more specific
>> than "Re: Contents of Crowbar digest..."
>> 
>> 
>> Today's Topics:
>> 
>> 1. Re: Errors building a Crowbar CentOS-5.7 ISO (Jord Tanner)
>> 2. failed to apply proposals in crowbar 1.2 (Lu.YJ at inventec.com<mailto:Lu.YJ at inventec.com>)
>> 3. RAID Controller in Physical Node (Neil Cowles)
>> 4. [SPAM] RE: RAID Controller in Physical Node
>> (Gregory_Althaus at Dell.com<mailto:Gregory_Althaus at Dell.com>)
>> 
>> 
>> ----------------------------------------------------------------------
>> 
>> Message: 1
>> Date: Tue, 3 Jan 2012 16:42:59 -0800
>> From: Jord Tanner <jord at terapeak.com<mailto:jord at terapeak.com>>
>> Subject: Re: [Crowbar] Errors building a Crowbar CentOS-5.7 ISO
>> To: <crowbar at dell.com<mailto:crowbar at dell.com>>
>> Message-ID:
>> <CAKxiZ1yfeA7sgapaPd3pKAMfru33-SHP6uyaRoazznUSSkGgQg at mail.gmail.com<mailto:CAKxiZ1yfeA7sgapaPd3pKAMfru33-SHP6uyaRoazznUSSkGgQg at mail.gmail.com>>
>> Content-Type: text/plain; charset="ISO-8859-1"
>> 
>>> From: Victor_Lowther at Dell.com
>>> To: davhodg at hotmail.com; crowbar at lists.us.dell.com
>>> Date: Tue, 3 Jan 2012 07:01:52 -0600
>>> Subject: RE: [Crowbar] Errors building a Crowbar CentOS-5.7 ISO
>>> 
>>> Yes, the upstream source we were pulling our ganglia rpm packages from vanished. We are looking at pulling in an alternate source (if we can find one -- we used this one because EPEL did not have the right version of ganglia) or rolling our own packages.
>>> ________________________________________
>>> From: crowbar-bounces On Behalf Of Dave Hodgson [davhodg at hotmail.com]
>>> Sent: Monday, January 02, 2012 7:06 PM
>>> To: crowbar
>>> Subject: [Crowbar] Errors building a Crowbar CentOS-5.7 ISO
>>> 
>>> Hi
>>> 
>>> I am trying to build a Crowbar CentOS 5.7 ISO. I keep getting an error when it is trying to stage the ganglia barclamp. I have have gotten past this by blowing away the git repo and the build cache, but I still cant get a clean ISO built. I am using Ubuntu 10.10 as the build server.
>>> 
>>> here is the error. Has anyone seen this?
>>> 
>>> ------------
>>> 2012-01-02 18:51:52 -0600: Staging hadoop barclamp.
>>> error: open of <!DOCTYPE failed: No such file or directory
>>> error: open of HTML failed: No such file or directory
>>> error: open of PUBLIC failed: No such file or directory
>>> error: open of -//IETF//DTD HTML 2.0//EN> failed: No such file or directory
>>> error: open of <html><head> failed: No such file or directory
>>> error: open of <title>403 failed: No such file or directory
>>> error: open of Forbidden</title> failed: No such file or directory
>>> error: open of </head><body> failed: No such file or directory
>>> error: open of <h1>Forbidden</h1> failed: No such file or directory
>>> error: open of <p>You failed: No such file or directory
>>> error: open of dont have permission to access /epel/5/ganglia-gmond-python-3.1.7-1.el5.x86_64.rpm on this server.</p> </body></html> failed: No such file or directory
>>> /root/crowbar/./build_lib.sh: line 537: pkgs["$pkgname"]: bad array subscript
>>> /root/crowbar/./build_lib.sh: line 189: 10454 Killed ( cd "$IMAGE_DIR"; exec ruby -rwebrick -e "WEBrick::HTTPServer.new(:BindAddress=>\"127.0.0.1\",:Port=>54321,:DocumentRoot=>\".\").start" &>/dev/null ) (wd: ~/crowbar)
>>> root at ubuntu10-build:~/crowbar#
>>> 
>>> ----------------
>>> 
>>> 
>>> thanks
>>> Dave
>> 
>> 
>> My solution has a few steps:
>> 
>> First, find the ganglia source RPMs with the correct version from a
>> Fedora mirror. This location looks sufficient:
>> http://mirror.its.sfu.ca/mirror/fedora/linux/releases/15/Everything/source/SRPMS/ganglia-3.1.7-3.fc15.src.rpm
>> 
>> Second, create your own CentOS 5.7 RPMs with rpmbuild (exact steps
>> left an an exercise for the reader)
>> 
>> Third, make the RPMs available via a http server. Location doesn't
>> matter, but make sure the crowbar build server has password free
>> access to the RPMs via HTTP.
>> 
>> Fourth, edit the file ~/crowbar/barclamps/ganglia/crowbar.yml and
>> change the lines that start with ' -
>> http://georgiou.fedorapeople.org' to refer to your own RPM locations.
>> The ganglia-debug rpm is not required. Note that the lines must start
>> with 4 spaces, then a dash, then a space. I learned from experience
>> that a tab is not permitted!
>> 
>> With that done you should be able to build the CentOS ISO!
>> 
>> You will run into other issues as well. There are some issues with
>> glibc versions and a few other libraries when you try and setup the
>> admin node. I solved this by downloading the full centos-5.7 extras
>> directory (http://mirror.its.sfu.ca/mirror/CentOS/5.7/extras/x86_64/RPMS/)
>> to /opt/dell/barclamps/crowbar/cache/centos-5.7/pkgs/updates/packages
>> on the admin node, then running 'install admin.crowbar.org', then
>> running 'yum update'. Note that there will be some dependencies that
>> yum can't solve and you will have to manually upgrade some RPMs using
>> 'rpm -Uvh', then run 'yum update' again. Downloading the full extras
>> directory was probably overkill, but I got tired of chasing
>> dependencies!
>> 
>> HTH, YMMV.
>> 
>> 
>> Jord Tanner, Director of Research? |??TERAPEAK
>> www.terapeak.com<http://www.terapeak.com>
>> 
>> 
>> 
>> ------------------------------
>> 
>> Message: 2
>> Date: Wed, 4 Jan 2012 14:58:39 +0800
>> From: <Lu.YJ at inventec.com<mailto:Lu.YJ at inventec.com>>
>> Subject: [Crowbar] failed to apply proposals in crowbar 1.2
>> To: <crowbar at dell.com<mailto:crowbar at dell.com>>
>> Message-ID:
>> <7AAA4DB16919AB4F9ADFB4784E0B563F834FF6 at TAO-MX8.iec.inventec<mailto:7AAA4DB16919AB4F9ADFB4784E0B563F834FF6 at TAO-MX8.iec.inventec>>
>> Content-Type: text/plain; charset="big5"
>> 
>> Hi all,
>> 
>> 
>> 
>> There is the issue described below. How to resolve it?
>> 
>> 
>> 
>> Issue: Failed to apply the proposal
>> 
>> 
>> 
>> Reproduce steps:
>> 
>> 1. Finish to install crowbar admin node (a VM) with openstack111219.iso (crowbar 1.2)
>> 
>> 2. Launch a node (a VM) to ready state (the node: d00-50-56-a5-00-0d.openstack.org)
>> 
>> 3. Create a proposal (with node d00-50-56-a5-00-0d) to mysql barclamp then apply it in crowbar web UI.
>> 
>> 4. Appear the error message ?Failed to apply the proposal to: d00-50-56-a5-00-0d.openstack.org?
>> 
>> 
>> 
>> Root cause:
>> 
>> Could not resolve hostname d00-50-56-a5-00-0d.openstack.org
>> 
>> 1. View the log file d00-50-56-a5-00-0d.openstack.org.chef_client.log below in /opt/dell/crowbar_framework/log in the admin node
>> 
>> stdin: is not a tty
>> 
>> ssh: Could not resolve hostname d00-50-56-a5-00-0d.openstack.org: Temporary failure in name resolution
>> 
>> stdin: is not a tty
>> 
>> ssh: Could not resolve hostname d00-50-56-a5-00-0d.openstack.org: Temporary failure in name resolution
>> 
>> 
>> 
>> Workaround:
>> 
>> Can work around the issue by adding ?192.168.124.81 d00-50-56-a5-00-0d.openstack.org d00-50-56-a5-00-0d? to ?/etc/hosts? in the admin node
>> 
>> 
>> 
>> YJ
>> 
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>> URL: http://lists.us.dell.com/pipermail/crowbar/attachments/20120104/ebe78be5/attachment-0001.html
>> 
>> ------------------------------
>> 
>> Message: 3
>> Date: Wed, 4 Jan 2012 12:01:06 +0000
>> From: Neil Cowles <Neil.Cowles at wtms.com<mailto:Neil.Cowles at wtms.com>>
>> Subject: [Crowbar] RAID Controller in Physical Node
>> To: <crowbar at dell.com<mailto:crowbar at dell.com>>
>> Message-ID:
>> <OF58ECA4E2.09D412C5-ON8025797B.0041C61B-8025797B.004204EA at westbourne-terrace.com<mailto:OF58ECA4E2.09D412C5-ON8025797B.0041C61B-8025797B.004204EA at westbourne-terrace.com>>
>> 
>> Content-Type: text/plain; charset="us-ascii"
>> 
>> Hi,
>> 
>> I've installed Crowbar 1.2 (Openstack) from the ISO download and all looks
>> good. When I boot up my first node it is detected and listed correctly
>> apart from it is not showing any hard disks - the node is an IBM xSeries
>> 3850 with a ServeRAID-8i controller - should I configure the controller to
>> just use the individual disks or can I use the RAID controller to manage
>> an array?
>> 
>> Thanks
>> Neil Cowles
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>> URL: http://lists.us.dell.com/pipermail/crowbar/attachments/20120104/19be41ad/attachment-0001.html
>> 
>> ------------------------------
>> 
>> Message: 4
>> Date: Wed, 4 Jan 2012 07:25:48 -0600
>> From: <Gregory_Althaus at Dell.com<mailto:Gregory_Althaus at Dell.com>>
>> Subject: [Crowbar] [SPAM] RE: RAID Controller in Physical Node
>> To: <Neil.Cowles at wtms.com<mailto:Neil.Cowles at wtms.com>>, <crowbar at lists.us.dell.com<mailto:crowbar at lists.us.dell.com>>
>> Message-ID:
>> <2ACBD73DB89FB14C999F91C3ACF279BC02A22F8A6E at AUSX7MCPC107.AMER.DELL.COM<mailto:2ACBD73DB89FB14C999F91C3ACF279BC02A22F8A6E at AUSX7MCPC107.AMER.DELL.COM>>
>> 
>> Content-Type: text/plain; charset="us-ascii"
>> 
>> You will need to configure the raid controller to present disks to the operating system by hand. The open source version of crowbar doesn't comprehend raid configuration. Depending upon the node's intended use, we recommend different things. For admin, nova controller, nova compute, swift proxy and hadoop name and edge nodes, we suggest a single disk with Raid 10 or Raid 5 (leaning to Raid10) depending upon your tolerances. For swift storage and hadoop data nodes, we recommend JBOD mode. Crowbar knows how to format and add all the single disks to the Swift storage and HDFS environments.
>> 
>> We are trying to decide what to do with our Raid barclamp. It currently works with a couple of LSI controllers on Dell hardware.
>> 
>> Thanks,
>> Greg
>> 
>> From: crowbar-bounces On Behalf Of Neil Cowles
>> Sent: Wednesday, January 04, 2012 6:01 AM
>> To: crowbar
>> Subject: [Crowbar] RAID Controller in Physical Node
>> 
>> Hi,
>> 
>> I've installed Crowbar 1.2 (Openstack) from the ISO download and all looks good. When I boot up my first node it is detected and listed correctly apart from it is not showing any hard disks - the node is an IBM xSeries 3850 with a ServeRAID-8i controller - should I configure the controller to just use the individual disks or can I use the RAID controller to manage an array?
>> 
>> Thanks
>> Neil Cowles
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>> URL: http://lists.us.dell.com/pipermail/crowbar/attachments/20120104/edef4de1/attachment.html
>> 
>> ------------------------------
>> 
>> _______________________________________________
>> Crowbar mailing list
>> Crowbar at dell.com<mailto:Crowbar at dell.com>
>> https://lists.us.dell.com/mailman/listinfo/crowbar
>> For More Information: https://github.com/dellcloudedge/crowbar/wiki
>> 
>> 
>> End of Crowbar Digest, Vol 7, Issue 2
>> *************************************
> <winmail.dat>



More information about the Crowbar mailing list