{{>toc}}

h1. Chiliproject

La machine chiliproject contient:

 - une base données postgres

 - une application installé dans /srv/http/chiliproject-X.X.X

 - le git de git.tetaneutral.net dans /srv/http/repositories

h2. L'application:

Le vhost d'apache est /etc/apache2/sites-enabled/chiliproject.tetaneutral.net, il pointe vers le répertoire /srv/http/chiliproject qui est un lien symbolique vers /srv/http/chiliproject-X.X.X

La procédure de mise à jour est la suivante:

<pre>

/etc/init.d/apache2 stop

# su - postgres

# pgdump chiliproject > chiliproject-3.X.X-20130108.sql

# exit

# cd /srv/http/chiliproject

# git fetch origin

# git branch ttnn-prod-3.6.0     # Création d'un nouvelle branche qui contient les modifications ttnn

# git checkout ttnn-prod-3.6.0   # Utilisation de cette branche

# git rebase v3.6.0              # rebase la branche ttnn avec la dernière version de chiliproject

</pre>

Et continuer les étapes 4 à 10 du howto de chiliproject (cf: https://www.chiliproject.org/projects/chiliproject/wiki/Upgrade#Step-4-Library-installation)

Version rapide:

<pre>

bundle update

gem cleanup

bundle update

bundle exec rake generate_session_store

bundle exec rake db:migrate RAILS_ENV=production

bundle exec rake db:migrate:plugins RAILS_ENV=production

bundle exec rake tmp:cache:clear

bundle exec rake tmp:sessions:clear

</pre>

Restart de chili

<pre>

/etc/init.d/apache2 start

</pre>

h2. La DB du postgres normal:

<pre>

# su - postgres

# psql chiliproject

chiliproject=# \dt

 public | attachments                         | table | chiliproject

 public | auth_sources                        | table | chiliproject

 public | boards                              | table | chiliproject

 public | changes                             | table | chiliproject

 public | changesets                          | table | chiliproject

 public | changesets_issues                   | table | chiliproject

 public | comments                            | table | chiliproject

 public | custom_fields                       | table | chiliproject

 public | custom_fields_projects              | table | chiliproject

 public | custom_fields_trackers              | table | chiliproject

 public | custom_values                       | table | chiliproject

 public | documents                           | table | chiliproject

 public | enabled_modules                     | table | chiliproject

 public | enumerations                        | table | chiliproject

 public | groups_users                        | table | chiliproject

 public | issue_categories                    | table | chiliproject

 public | issue_relations                     | table | chiliproject

 public | issue_statuses                      | table | chiliproject

 public | issues                              | table | chiliproject

 public | journal_details                     | table | chiliproject

 public | journals                            | table | chiliproject

 public | member_roles                        | table | chiliproject

 public | members                             | table | chiliproject

 public | messages                            | table | chiliproject

 public | news                                | table | chiliproject

 public | open_id_authentication_associations | table | chiliproject

 public | open_id_authentication_nonces       | table | chiliproject

 public | projects                            | table | chiliproject

 public | projects_trackers                   | table | chiliproject

 public | queries                             | table | chiliproject

 public | repositories                        | table | chiliproject

 public | roles                               | table | chiliproject

 public | schema_migrations                   | table | chiliproject

 public | settings                            | table | chiliproject

 public | taggings                            | table | chiliproject

 public | tags                                | table | chiliproject

 public | time_entries                        | table | chiliproject

 public | tokens                              | table | chiliproject

 public | trackers                            | table | chiliproject

 public | user_preferences                    | table | chiliproject

 public | users                               | table | chiliproject

 public | versions                            | table | chiliproject

 public | watchers                            | table | chiliproject

 public | wiki_content_versions               | table | chiliproject

 public | wiki_contents                       | table | chiliproject

 public | wiki_pages                          | table | chiliproject

 public | wiki_redirects                      | table | chiliproject

 public | wikis                               | table | chiliproject

 public | workflows                           | table | chiliproject

</pre>

h2. Howto/Script Migration chiliproject to redmine

<pre>

# -*- coding: utf-8 -*-

# vim: ts=4: set ft=sh

#

# CC-BY Mehdi Abaakouk <sileht@sileht.net>

# Inpired from this ruby/mysql version: https://gist.github.com/pallan/6663018

#

# On postgres User

$ createuser -P redmine

$ createdb redmine  -O redmine 

$ pg_dump chiliproject > toredmine.sql

$ psql redmine < toredmine.sql

$ psql redmine <<EOF

ALTER DATABASE redmine OWNER TO redmine;

REASSIGN OWNED BY chiliproject TO redmine;

ALTER TABLE journals RENAME COLUMN created_at TO created_on;

ALTER TABLE journals RENAME COLUMN journaled_id TO journalized_id;

ALTER TABLE journals RENAME COLUMN activity_type TO journalized_type;

ALTER TABLE journals ALTER COLUMN journalized_type TYPE character varying(30);

ALTER TABLE journals ALTER COLUMN journalized_type SET NOT NULL;

ALTER TABLE journals ALTER COLUMN journalized_type SET DEFAULT ''::character varying ;

EOF

# On root:

$ cd /srv/http

$ tsocks git clone https://github.com/redmine/redmine.git -b 2.5-stable

$ cd redmine

$ cat > config/database.yml <<EOF

production:

    adapter: postgresql

    database: redmine

    host: localhost

    username: redmine

    password: redmine

EOF

$ tsocks bundle install --without development test rmagick

$ bundle exec rake generate_secret_token

$ RAILS_ENV=production bundle exec rake db:migrate

# On postgres user:

$ psql redmine <<EOF

ALTER TABLE wiki_contents ADD comments VARCHAR(250) NULL;

ALTER TABLE wiki_contents RENAME COLUMN lock_version TO version;

ALTER TABLE wiki_contents ALTER COLUMN version TYPE INTEGER;

ALTER TABLE wiki_contents ALTER COLUMN version SET NOT NULL;

UPDATE journals SET journalized_type='Issue' WHERE journalized_type='issues';

ALTER TABLE journals RENAME COLUMN changes TO changes_chili;

ALTER TABLE journals DROP COLUMN type;

EOF

$ python <<EOF

import yaml;

import psycopg2

conn = psycopg2.connect("dbname='redmine' user='redmine' host='localhost' password='redmine'")

commit = 100

cur = conn.cursor()

cur.execute("""SELECT id, version, journalized_type, journalized_id, changes_chili,created_on, notes, user_id FROM journals order by version desc""")

rows = cur.fetchall()

cur.close()

dataissue = []

datawiki = []

for row in rows:

    id = row[0]

    version = int(row[1])

    type = row[2]

    jid = row[3]

    raw_changes = row[4]

    created_on = row[5]

    notes = row[6]

    user_id = row[7]

    if type in ["time_entries", "documents"]: # only have 1 item each

        continue

    elif type == "attachments": # 163

        continue

    elif type == "messages": # 3

        continue

    elif type == ["Issue", "attachments"] and version > 1:

        changes = yaml.load(raw_changes)

        for k, v in changes.iteritems():

            if k == "attachment":

                property = 'attachment'

                prop_key = re.sub("\d+", "", k)

            elif k == "custom_values":

                property = 'cf'

                prop_key = re.sub("\d+", "", k)

            else:

                property = 'attr'

                prop_key = k

            dataissue.append({'id': id,

                         'property': property,

                         'prop_key': prop_key,

                         'old_value': v[0],

                         'new_value': v[1],

                        })

    elif type == "wiki_edits":

        changes = yaml.load(raw_changes)

        datawiki.append({

            'id': id,

            'wiki_content_id': jid,

            'page_id': jid,

            'author_id': user_id,

            'data': bytearray(changes.get('data'), encoding="utf-8"),

            'compression': changes.get('compression', None),

            'updated_on': created_on,

            'comments': notes,

            'version': version,

        })

    if len(dataissue) > commit:

        cur = conn.cursor()

        cur.executemany("""INSERT INTO journal_details (journal_id, property, prop_key, old_value, value) VALUES (%(id)s,%(property)s,%(prop_key)s,%(old_value)s,%(new_value)s)""", dataissue)

        cur.close()

        dataissue = []

    if len(datawiki) > commit:

        cur = conn.cursor()

        cur.executemany("""INSERT INTO wiki_content_versions (id, wiki_content_id, page_id, author_id, data, compression, comments, updated_on, version) VALUES (%(id)s, %(wiki_content_id)s, %(page_id)s, %(author_id)s, %(data)s, %(compression)s, %(comments)s, %(updated_on)s, %(version)s)""", datawiki)

        cur.close()

        datawiki = []

cur = conn.cursor()

cur.executemany("""INSERT INTO journal_details (journal_id, property, prop_key, old_value, value) VALUES (%(id)s,%(property)s,%(prop_key)s,%(old_value)s,%(new_value)s)""", dataissue)

cur.close()

cur = conn.cursor()

cur.executemany("""INSERT INTO wiki_content_versions (id, wiki_content_id, page_id, author_id, data, compression, comments, updated_on, version) VALUES (%(id)s, %(wiki_content_id)s, %(page_id)s, %(author_id)s, %(data)s, %(compression)s, %(comments)s, %(updated_on)s, %(version)s)""", datawiki)

cur.close()

conn.commit()

conn.close()

EOF

$ psql redmine <<EOF

DELETE FROM journals WHERE (notes IS NULL OR notes = '' ) AND changes_chili IS NOT NULL AND NOT EXISTS (SELECT 1 FROM journal_details x where x.journal_id=journals.id);

ALTER TABLE journals DROP COLUMN changes_chili;

ALTER TABLE journals DROP COLUMN version;

EOF

# On root in /srv/http/redmine:

$ RAILS_ENV=production REDMINE_LANG=fr bundle exec rake redmine:load_default_data

$ cat > mailhandler.sh <<EOF

#!/bin/bash

exec bundle exec ruby extra/mail_handler/rdm-mailhandler.rb --url http://chiliproject.tetaneutral.net/ --key lVYqSEk1kAUtwsXe3qzf --project tetaneutral.net"

EOF

$ chmod +x mailhandler.sh

# change in /etc/aliases the chiliproject alias to:

chiliproject: "|/srv/http/redmine/mailhandler.sh"

# Dans /etc/apache2/site-enabled/chiliproject changer les '/srv/http/chiliproject/public' en '/srv/http/redmine/public'

# Et ajouter en tout en haut du fichier 'PassengerDefaultUser www-data'

# Copie des fichiers uploadé:

$ cd /srv/http/redmine

$ rsync -a ../chiliproject/files/ files/

# Remise à plat des permissions:

$ chown -R redmine:redmine files log tmp public/plugin_assets

$ chmod 755 files log tmp public/plugin_assets

$ find files -type d -exec chmod 755 {} \;

$ find public/plugin_assets -type d -exec chmod 755 {} \;

$ find log -type d -exec chmod 755 {} \;

$ find tmp -type d -exec chmod 755 {} \;

$ find files -type f -exec chmod 644 {} \;

$ find public/plugin_assets -type f -exec chmod 644 {} \;

$ find log -type f -exec chmod 644 {} \;

$ find tmp -type f -exec chmod 644 {} \;

</pre>

h2. Problemes

Lors de la migration

# TODO ?