Compiling Remus-enabled DRBD

Compiling Remus-enabled DRBD

rahulsinghumass 23 Mar 2012 16:20

Hi,
I am trying to get Remus running. I have installed the latest Xen (4.2) from source, compiled the latest linux kernel as Dom0 (3.2.12). I am trying to compile the Remus enabled DRBD as told in the wiki. I am running into the error /usr/src/linux-3.2.12/scripts/recordmcount. My question is, will Remus run if i just use the latest DRBD without the Remus changes for disk replication ? If no, how do i compile the Remus-enabled DRBD on the latest kernel ?

Thanking you,
Rahul

Re: Compiling Remus-enabled DRBD

rshriram 23 Mar 2012 16:32

Remus with default drbd: no it work. It requires protocol D.

Compiling remus enabled DRBD: can you give more details of the error?
The one you posted makes no sense.

Re: Compiling Remus-enabled DRBD

rahulsinghumass 23 Mar 2012 21:34

So i do not need to use the aramis_nss_cs_ubc_ca/drbd-8.3-remus ? DRBD currently does not support Protocol D from what i read in its documentation, so i am wondering how can i make the default DRBD (one that i get from oss_linbit_com/drbd/8.4/drbd-8.4.1.tar.gz) work with Remus.

I am trying to compile aramis_nss_cs_ubc_ca/drbd-8.3-remus following the instructions on remusha_wikidot_com. After i go "cd /usr/src/drbd-8.3-remus/drbd
;make clean;
make", i get a compilation error: include/linux/blkdev.h:943:12: note: expected ‘gfp_t’ but argument is of type ‘void *’
/usr/src/drbd-8.3-remus/drbd/drbd_int.h:2655:2: error: too few arguments to function ‘blkdev_issue_flush’

Thanking you,
Rahul

Re: Compiling Remus-enabled DRBD

rshriram 28 Mar 2012 18:00

Sorry about the misleading reply earlier. It was a typo. I meant to say that Remus will NOT work with default DRBD.
You need to download the one from aramis.nss.cs.ubc.ca and compile it.

About the compilation error:
I just tried to compile the code against 2.6.38 (ubuntu). Looks like a lot of block dev interfaces have changed.
give me sometime and I ll update the repo accordingly.

thanks
shriram

Re: Compiling Remus-enabled DRBD

rahulsinghumass 23 Mar 2012 22:21

I googled for it and found out that this problem has been encountered by users trying to compile drbd version 8.3.9 or other with kernel > 2.6.35. gossamer-threads_com_lists_drbd_users_20387. Have you encountered any such compilation problems when compiling the Remus-enabled-DRBD on newer kernels ?

Re: Compiling Remus-enabled DRBD

Higs Boson 08 Aug 2012 18:39

Hi,

I have already built xen 4.2 and linux 2.6.32 kernel for dom0. Now I am trying to compile the drdb-8.3-remus but the git repo is not responding. Git clone is throwing up an error that it can access the repo with the follow path:

git clone git://aramis/drbd-8.3-remus drbd-8.3-remus

I tried to access the root server and that is responding but not the git repo. Can any body point whats the source of this problem?

Thank you.

Re: Compiling Remus-enabled DRBD

rshriram 08 Aug 2012 21:19

The url is git://aramis.nss.cs.ubc.ca/drbd-8.3-remus

I just cloned it from an external box (on a different network)
and it works. I suggest you check the proxy settings or
such. [I am no good at suggesting solutions to the these kind of
issues :) ]

Re: Compiling Remus-enabled DRBD

Higs Boson 09 Aug 2012 10:16

Hi Shiriram,

Thank you for the quick test. Actually I couldn't post the complete server address as this wiki restrict new users to do that.

Certainly, the issue is with the proxy setting. I have played with them now by setting proxy on the network configuration. Xen unstable .configure script allows 2—enable-githttp" to use default proxy settings on my ubuntu machine and it worked. But for drbd patch, GIT is not working well (for the moment) with my default proxy setting despite GIT_HTTP=y and also enabling it in the config e.g.

git config --global http.proxy proxyserver:port

I also tried socat/netcat to connect to aramis and it worked to a certain degree but eventually failed with the following error:

Cloning into drbd-8.3-remus...
nc: read failed (0/3): Broken pipe
fatal: The remote end hung up unexpectedly

I can see that there is DRBD package available via apt-get, wouldn't it work if one uses that one from the ubuntu respository rather than building it from source from the aramis git repo. Are there any remus-specific changes in this version?

Cheers

Re: Compiling Remus-enabled DRBD

Higs Boson 09 Aug 2012 11:28

I also tried replacing git with http protocol, and received different errors.

Cloning into 'drbd-8.3-remus'...
error: The requested URL returned error: 503 while accessing http path /info/refs
fatal: HTTP request failed

I am wondering if its possible to have access to the tarball of the sources so that we could build it locally. Accessing GIT via proxies is kind of bottleneck. I would really appreciate if the repo admins could provide also link to the drbd-8.3-remus source tarball.

Thank you.

Re: Compiling Remus-enabled DRBD

rshriram 09 Aug 2012 13:00

I have put up the source tarball in the wiki. Check the tutorial for the link.

Re: Compiling Remus-enabled DRBD

Higs Boson 09 Aug 2012 14:53

Thank you very much Shiriam for making the tarball available :)

I noticed that you updated the twiki to xen 4.1.2; does that mean one doesn't have to apply the xen specific pataches any more for xen-unstable 4.2?

Secondly, I would like to point few minor corrections to the twiki for each section:

Setting up the Dev Environment
For apt-get, these pkgs are also need

apt-get install libyajl-dev yajl-tools libglib2.0-dev libsdl-ttf2.0-0 libsdl-ttf2.0-dev

Download and Install Xen 4.1.2 from Xensource Repo
correct mercurial path to hgrc.d is the following:

/etc/mercurial/hgrc.d/hgext.rc

For configuring xen 4.1.2 sources, prior to make clean configure is needed

./configure
# if behind proxy, then enablt git over http for xen configure file.
# ./configure --enable-githttp

Secondly, for drbd-hvm-fix subsectionitalic text, ioemu-remote dir has been renamed. Following is the patch of the qemu directory to apply the patch:

cd /usr/src/xen-4.1.2/tools/qemu-xen-traditional-dir-remote

Download and install Xen-tools 4.2.1
There is newer version of xen tools available (4.3.1). Unless it's not compatible, here is the wget updated link

wget [low-kerma-user-can't-post-http-link] /software/xen-tools/xen-tools-4.3.1.tar.gz

Thanks again for all your prompt help. Cheers
Omar

Last edited on 09 Aug 2012 15:14 by Higs Boson + Show more

Re: Compiling Remus-enabled DRBD

rshriram 09 Aug 2012 15:12

Fixed the wiki. Thanks for pointing out the errors in the tutorial. As for your question about xen 4.1.2 vs unstable,
if you havent spent much effort on getting xen-unstable running, I suggest you switch to 4.1.2 and apply the
patches in the wiki. There are lots of changes in unstable and I havent kept track of it unfortunately.
Some users reported that Remus is too slow and running multiple remus instances on the same host doesnt
work.

Re: Compiling Remus-enabled DRBD

rahulsinghumass 10 Aug 2012 20:56

Hi Shriram,
I tried running xen 4.1.2, to fix the problem of not being able to run multiple remus instances on the same host. Even in that version i get the same problem when i try to run multiple remus instances on the same host:

xc: error: Suspend request failed: Internal error
xc: error: Domain appears not to have suspended: Internal error

Do you know how far back into Xen should one go to get back that functionality ?

Thanking you,
Rahul

Re: Compiling Remus-enabled DRBD

rshriram 12 Aug 2012 19:01

Can you please take this to a different thread.. its confusing :).
I think xen 4.1 should be sufficient.. What kind of guest are you running ?
When you said multiple remus instances, do you mean
remus -i 100 Guest1 backupHost >logfile
remus -i 100 Guest2 backupHost >logfile

If so, I suggest you look at the syslog or xend.log or the remus log file for the failing
domain. I suspect that something is wrong with the drbd setup .

Re: Compiling Remus-enabled DRBD

Higs Boson 09 Aug 2012 15:52

Now moving to next step to build and install drbd-remus packages, I am wondering what the following command is doing in the context of drbd sources?

dpkg-buildpackage -b -uc

Its break on my system with the following error:

make[1]: Entering directory `/home/Work/remus/src/drbd-8.3-remus'
/usr/bin/make -C drbd drbd_buildtag.c
make[2]: Entering directory `/home/Work/remus/src/drbd-8.3-remus/drbd'
Makefile:95: *** "won't compile with this kernel version".  Stop.
make[2]: Leaving directory `/home/Work/remus/src/drbd-8.3-remus/drbd'
make[1]: *** [drbd/drbd_buildtag.c] Error 2
make[1]: Leaving directory `/home/Work/remus/src/drbd-8.3-remus'
make: *** [build-arch-stamp] Error 2
dpkg-buildpackage: error: debian/rules build gave error exit status 2
root@ubuntu:~/Work/remus/src/drbd-8.3-remus# man dpkg-buildpackage

I am on Ubuntu 12.04:

Linux ubuntu 3.2.0-27-generic-pae #43-Ubuntu SMP

Last edited on 09 Aug 2012 15:56 by Higs Boson + Show more

Re: Compiling Remus-enabled DRBD

Higs Boson 11 Aug 2012 18:39

Hi,

I rebuilt the drbd-remus (using the tarball) on Ubuntu 10.04 with kernel 2.6.32.38 and this time it worked. Any ways, dpkg-buildpackage -b- uc failed complaining about drbd/drbd_buildtag.c file not found in the tree. I found the file in online archive and recreated the file under drbd/drbd_buildtag.c. This enabled me to successfully build and install drbd-8.3.9-remus package.

drbd_buildtag.c file:

/* automatically generated. DO NOT EDIT. */
#include <linux/drbd.h>
const char *drbd_buildtag(void)
{
      return "GIT-hash: 1c3b2f71137171c1236b497969734da43b5bec90"
            " build by phil@fat-tyre, 2010-10-22 17:09:03";
}

@Shiriram: perhaps you can check in the tarball why this file is wasn't packaged. And whether the above GIT has is the correct one?

Cheers

Re: Compiling Remus-enabled DRBD

rshriram 12 Aug 2012 19:03

You need to run autogen.sh first. IIRC. I think that generates the buildtag.c file.
And then you run dpkg-buildpackage..

Re: Compiling Remus-enabled DRBD

Higs Boson 14 Aug 2012 08:53

Hi Shriram,

I actually ran the autogen.sh command first but still buildtag.c file wasn't there. In any case, the work around to manually create the file worked.

Cheers