Days of ... (software)

Revised: Save Hudson/Jenkins settings and installed plugins

Tue, 23 Apr 2013 07:42:07 GMT

.. code:: bash
 #!/bin/bash
JENKINS_FOLDER="/shared/jenkins"
DEST_FOLDER="/jenkins-backup"
if [ ! -d "${DEST_FOLDER}" ]; then
  mkdir -p ${DEST_FOLDER}
fi
if [ ! -d "${DEST_FOLDER}/jobs" ]; then
  mkdir -p ${DEST_FOLDER}/jobs
fi
cd ${JENKINS_FOLDER}
pwd
/usr/bin/rsync -v -a --relative --checksum ./*.xml ${DEST_FOLDER}
/usr/bin/rsync -v -a --relative --checksum ./plugins/ ${DEST_FOLDER}/
cd ${JENKINS_FOLDER}/jobs
pwd
find . -maxdepth 2 -name "config.xml" -print0 | /usr/bin/rsync -v -a --relative --checksum --files-from=- --from0 ./ ${DEST_FOLDER}/jobs/

SOLVED: VIM in terminal not rendering backround color properly

Fri, 19 Apr 2013 02:37:23 GMT

The long worded solution

TL;DR


if &term =~ '256color'
  set t_ut=
endif

The case of missing JNDI branches

Sun, 20 Nov 2011 22:02:42 GMT

I’ve got a complaint from one of the developers: the JMS resources, defined in his local instance of Weblogic server, are defined correctly, but he can’t use them from the application he developing – the names are not present in JNDI tree. The problem is that in our environment the same scripts are used to create all Weblogic instances, from local development through production.

Quick look through Weblogic Console JNDI browser confirmed that the JMS resources are not in the tree. I took a look for exceptions or errors in the log files – everything looks ok, the logs are clean. Then I tried to change one of the parameters of the JMS resources and then Weblogic complained with the message saying that JMS resource is not yet started. And in the console it looks like it started ok.

Then I took a look at the Git logs of the recent changes for this type of the Weblogic domain and the only change was an introduction of the JDBCStores for JMS resources. But where are local development machines are pointed to? Is it local Oracle XE database? No, they are pointed to the shared database, used by other environment. This is clearly wrong! I don’t think that JDBCStore implementation is smart enough to recognise that connections are coming from different domains. So I removed JDBCStore usage from development domain and restarted it – voila, JMS resources are now in JNDI tree!

So Weblogic was misconfigured, but was silently ignoring the fact that it can not recognise data from JDBCStore and manifested it through JNDI tree. How weird!

SOLVED: Save Hudson configs to Subversion. Automatically.

Wed, 13 Oct 2010 07:51:41 GMT

I decided to save Hudson configs to Subversion repository just in case something goes wrong with the server later and would need to restore all projects. A bit of googling first, found that there are plugins to to a backup of workplaces and configs. But why would I need to have them? I am on Solaris, so I can create the same by my own hands. Here are my requirements:

Backup should be a job within Hudson - since Hudson is a best cron you could find and I already have it
Backup should automatically discover added jobs and add then into Subversion - thus I will forget about it forever, no maintenance required

Simples! So I created a custom build job within Hudson, pointed it to a Subversion location, where I will store backups and backup shell script, which will gather all Hudson configs and deal with Subversion. I told Hudson that I don't want to create subfolder for a project within its workplace. Then I set to execute script this way: ${WORKPLACE}/hudsonbackup.sh Here is the script itself:

#!/bin/bash

SRC_FOLDER=${WORKSPACE}

SVN_PARAMS="--config-dir /.subversion/ --non-interactive --trust-server-cert --username f_tc_ci1 --password *"

SVN_COMMAND="/opt/csw/bin/svn"

JOBS=ls -al /.hudson/jobs/|grep -v job1|grep -v job2|awk ' NR>3 {print $9}'

CURR_FOLDER=pwd

echo "Copying Hudson configs"

cp /.hudson/*.xml ${SRC_FOLDER}

echo "Done."

cd ${SRC_FOLDER}

echo "Processing Hudson jobs"

for JOB in ${JOBS}

do echo "Processing ${JOB}" if [ ! -e ${JOB} ] then echo "New job. Creating folder and adding it to SVN" mkdir ${JOB} ${SVN_COMMAND} add ${SVN_PARAMS} ${JOB}
SVN_COMMENT="${SVN_COMMENT} Added ${JOB}" fi

echo "Saving ${JOB}/config.xml" if [ -e ${JOB}/.svn ] then if [ -e ${JOB}/config.xml ] then # config.xml already exist - don't need to add it to subversion cp /.hudson/jobs/${JOB}/config.xml ${JOB}/ else echo "New job - new config.xml" cp /.hudson/jobs/${JOB}/config.xml ${JOB}/ ${SVN_COMMAND} add ${SVN_PARAMS} ${JOB}/config.xml fi else echo "Problem creating and adding folder to Subversion" exit 1 fi done

echo "Job processing is done. Committing..."

${SVN_COMMAND} ci ${SVN_PARAMS} -m "Config saved by Hudson. ${SVN_COMMENT}"

echo "All done."

Note 1: My Subversion is on HTTPS server with the self-signed certificate, so I have to tell Subversion client to trust it explicitly. Its on line 4. On line 5 I constructed the path to Subversion client because Hudson executing shell scripts with quite limited PATH. Note 2: I need to ignore some jobs, so I added them on line 6. Also on this line I have hardcoded Hudson location ("/.hudson") - it needs to be changed if your Hudson somewhere else. After all that I set this job to execute daily. It works!

Make Home/End/Delete keys work in Solaris bash

Mon, 22 Jun 2009 16:14:14 GMT

This is most frustrating thing that I experience when I encounter Solaris bash prompt: the Home, End and Delete keyboard keys will not work because for some reason Solaris doesn’t understand them as useful keys. But there is the way to enable those keys!

Add following lines to your ~/.bashrc file:

# home key
bind '"e[1~":beginning-of-line'
# del key
bind '"e[3~":delete-char'
# end key
bind '"e[4~":end-of-line'
# pgup key
bind '"e[5~":history-search-forward'
# pgdn key
bind '"e[6~":history-search-backward'

Save and source file. Now keys will work as they should.

VMWare DHCP service wont’start - SOLVED

Fri, 08 May 2009 12:43:22 GMT

I use VMWare to run a bunch of different Linux VMs on my home PC, which is running Vista SP1. Today I encountered strange thing: Linux VM won’t get an IP address from VMWare DHCP. I’ve opened VMWare Virtual Networks management console (as Administrator, of course, or it won’t let you make and save any changes) just to find out that DHCP service is not started. I tried to start it from there, but it failed to do so.

So I went to Vista Services console and tried to start “VMWare DHCP service from there”. Again, failed to start with no explanation, even cryptic one. So I went to Windows Events viewer and there, under Windows Logs-System, I found a lot of messages from VMNetDHCP:

The description for Event ID 2 from source VMnetDHCP cannot be found. Either the component that raises this event is not installed on your local computer or the installation is corrupted. You can install or repair the component on the local computer.

If the event originated on another computer, the display information had to be saved with the event.

The following information was included with the event:

Can't open C:ProgramDataVMwarevmnetdhcp.conf: Access is denied.

/ The data is invalid

the message resource is present but the message is not found in the string/message table

Though the message says that the message is not found, it has enough information to fix the problem.

So, I’ve taken a look at the security properties for C:ProgramDataVMWare folder and found that SYSTEM account somehow is not in a list of permitted users. The only account, who was permitted to access that folder, was my Windows user account. So I added SYSTEM account with all permissions to this folder, waited when Windows propagated my change to all files and tried to start VMWare DHCP service again. It worked!

Then I simply restarted network within Linux VM (sudo /etc/init.d/networking restart) and got back to work.

JBOSS Seam 2.1.1GA on JBOSS AS 5.0.1GA: Table is not mapped

Thu, 07 May 2009 18:37:46 GMT

I created sample JBOSS Seam project in Eclipse and decided to generate entity code from existing database. It worked fine, but when I try to run it, it shows me that Hibernade is not able to map entity beans to the corresponding tables. The error message is like this:

org.hibernate.hql.ast.QuerySyntaxException: <your table> is not mapped

I spent around three hours trying to read all available information on it, but most of it just useless – it looks like people don’t know whats happening, so they recommend bizarre tricks. Like, for example, having empry seam.settings file in each folder, meh.

Finally, I found the solution in Seam Jira: https://jira.jboss.org/jira/browse/JBSEAM-3821

They rocemmend to to force Hibernate to use Seam’s EntityManager by changing two files:

1. components.xml

<persistence:entity-manager-factory name="bookingDatabase" installed="false"/>
    
    <persistence:managed-persistence-context name="em" auto-create="true"
       entity-manager-factory="#{bookingDatabase}" persistence-unit-jndi-name="java:/bookingEntityManagerFactory"/>

2. persistence.xml

<property name="jboss.entity.manager.factory.jndi.name" value="java:/bookingEntityManagerFactory"/>

Hope that Google will find that page and the proper solution would be much more easily found!

Trying Team Concert build system

Tue, 28 Oct 2008 12:30:55 GMT

After yesterday’s success in installation of Team Concert, I went through the “Do and Learn” tutorial. The amount of new information and, especially, new views in IDE, is overwhelming! Though the tutorial tries its best to guide through sample project, it would take my time to digest the information. So far, I managed to get through it, but have been stuck on building my HelloWorld application.

The problem is that freshly created build engine, named “HelloWorldEngine”, telling me that Jazz Build Engine is not yet connected to repository. But in another window jbe.exe process is connected and waiting for builds.

I restarted jbe with –verbose parameter to see what it does, but this resulted in only one additional line to be displayed: “2008-10-28 12:16:42 [Jazz build engine] Not using a proxy to reach https://localhost:9443/jazz/” I would expect it to be more verbose that that. Perhaps it needs to tell me something more about which build engine id it tries to use…

And build engine id is exactly my problem here. By default jbe is going to use “default” build engine, not my “HelloWorldEngine”. There is parameter, which is not mentioned in tutorial, but mentioned if you try to run jbe.exe:

-engineId <engine id> (engine id of a build engine defined in the Jazz repository, default is "default")

Once I started jbe with proper parameter – my build was fired off.

And first one was a failure:

com.ibm.team.build.internal.engine.InvalidPropertyValueException: CRRTC3512E: The location "C:javajazzbuildsystembuildengineeclipsefetchedScrumProjectbuild.xml" referenced by property "com.ibm.team.build.ant.buildFile" does not exist.

This is because I named Team Concert project “ScrumProject”, but in Java perspective I followed HelloWorld cue card and named my Java project “HelloWorld”. The build system was puzzled to find it. Team Concert Tutorial says this:

13. In the Build file field, type the following path: fetched/projectname/build.xml, where projectname is the name of your Jazz project.

This is not exactly the truth. This should have the name of my Java project.

So I went and fixed the project name in Ant tab. Requested the build and, voila, it builds!

Now its time to create new project, which will do something bigger, than printing “Hello, World!”

Trying Rational Team Concert

Mon, 27 Oct 2008 10:27:06 GMT

Image via CrunchBase

After rave reviews from my coworkers, who seen the IBM presentation, I decided to give it a try on my local machine. As it usually happens with IBM beta software, the expectancy of it working is close to zero. Let’s give it a try this time, could it be better?

First, I headed to http://jazz.net/ to download software. The server, obviously, managed by IBM marketing department, requires to register. Usual IBM ID is not supported, so I had to give IBM my email once again.

Since I only need a software for basic trial, I decided not to download version, which supports DB2 and Oracle databases. There is no support for MySQL either, but at least they promise to include Derby in setup package. So I pointed that I want Windows installation and found that download size is about 400Mb, and there is no IBM Download Manager (which I hate) to be seen.

So I downloaded and unpacked everything to my hard drive. I am on Windows and Windows users are used to find setup.exe, which does installation of the software for you. There is no such thing here: only install_express_c.html file, which describes step by step installation procedure for both Windows and Linux. Why Linux if I specifically stated that I want Windows installation?

First step says that I have to navigate to Tomcat’s folder and then run server.startup.bat file. There is no such file! The actual file named startup.bat. So I executed it, new command line window popped out and it is full of exceptions. Something about IbmX509 KeyStoreManager is nowhere to be found. Of course it can not be found because I am not running IBM JVM! What kind of assumption is to expect that everybody in the world are on IBM JVM, huh? I had to dig into Tomcat’s server.xml to set it to use Sun’s X509 keymanager (simply open tomcat/conf/server.xml, find IbmX509 and replace it with SunX509).

After quick restart Tomcat is happy and I can open, according to instructions, Jazz setup screen, which is a web application running within Tomcat. The setup has two options: “Fast Path” and “Custom setup”. I’ve chosen Fast Path because I am happy with the defaults, whatever they are. Click on “Fast Path” gets me to “Setup User Registry” screen, which has “A problem occurred while loading User Registry settings.” error message displayed. Hmm… Let’s head back to installation guide:

The default user name and password are case-sensitive:

The user name is ADMIN.

The password is ADMIN.

If you configured the LDAP directory Web container, log in with a JazzAdmin user that is defined in your LDAP directory.

What? I have to configure LDAP directory Web container first? This is first time it mentioned in this “guide”! How do I do that? There is no answer.

Ok, Fast Path is broken, so let’s try Custom setup. Click. “Loading Database Connection settings…” No progress here as well. Nothing about such problems in tomcat logs, nothing in server troubleshooting section of installation guide.

So there is no Rational Team Concert for me for now. Would I recommend it for use on my next project?

Update: Decided to dig around filesystem, looking for something useful like logs and other batch files. Found some logs in Tomcat cache folders (tomcat/work/Catalina/localhost) with the ClassNotFound messages. Found jars, containing missing class and added it to CLASSPATH. No help.

Then found mentioned above server.startup.bat and tried to run it. Now it complained about SunX509 KeyManager, so I returned the IbmX509 KeyManager back. Still no help progressing with Jazz Setup…

And then I decided to run repotools.bat – just in case the repository got corrupted or something. Execited it with parameter –createTables, it done something with something.

Tried Jass Setup page again and now it worked! Whoa!

How to get rid of .svn folders

Wed, 03 Oct 2007 14:16:04 GMT

Use Ant!