Better, Stronger, Faster! A New Open Atrium Installer. May 8, 2014 in Drupal 15 Comments on this post. http://www.alexweber.com.br/ Alex Weber Nice! Feature-based distributions (are there other kinds?) are notoriously difficult to maintain because of this kind of issues… I’ve personally lost track of just how much time I’ve spent installing, clearing databases, looking at logs, tweaking a line of code and re-installing over and over again because the installer just stopped working all of a sudden. It’s also almost always related to a new feature export that’s causing interdependencies and changing up module installation orders and things get out of whack. A lot of times I wonder whether it’s worth it and somewhat miss the D6 days where every project started from a base build and no node ever had id 1 anymore Whereas it might seem like a step back, I actually kinda like the idea of starting from a dump, not only to solve this particular issue, but in general, for distributions. Wouldn’t it be nice to install, get demo content, jump right into it without having to jump through the same hoops over and over? Just boom, instant Drupal! Specially as far as in-house distros go… maybe I’m just infatuated with this idea but either way, this is very cool, thanks for sharing! Othermachines Works like a charm. Tim Loudon that’s super cool! do you know offhand if this is something that would easily work w/ any distro? briefly looking @ the install_from_db.profile code, it doesn’t look like it’s oa specific. btw, i’m wondering if there are further optimizations to be had: [tloudon@addy install_from_db]$ time mysql tester < ../db/openatrium.sql real 0m21.732s user 0m0.257s sys 0m0.123s the actual db importing part only takes ~22s. could you split openatrium.sql into two files, one for "constants" across installations and another for the installation-specific transformations? i'm guessing the ~100-160s is largely spent parsing and regexing the 2.6mb dumpfile; but how much actually needs to be changed? idk, just a thought. again, super cool. thanks for sharing! Mike Potter It shouldn’t be distribution-specific, but since installers are a bit complex, your mileage may vary. The bulk of the new install time is actually the clearing of the drupal cache after the databases are imported. The parsing and regexing goes quickly. But after importing the tables you need to clear the drupal cache. Then after entering site information the Drupal installer clears the cache again. I didn’t want to get fancy with splitting the sql file or anything. My release process is to add a “drush sql-dump” command to my Jenkins test script that does a “drush site-install” for each release to verify it can be installed. So unless it can easily be automated like this, the work involved in splitting the db dump and keeping it updated wouldn’t be worth the small time savings. Donovan Dilon Mike, thank you very much for posting this! The OA2 install approach is clever and very useful. I’m attempting to adapt the install script and install_from_db.profile code for use with a custom distribution. Almost everything works .. however the install_from_db code triggers the following error: “An AJAX HTTP request terminated abnormally. .. StatusText: ResponseText: ReadyState: 4″ … which is identical to this OA2 error reported on Drupal.org: https://www.drupal.org/node/2276509. The case suggests a memory issue, but my distribution is not as complex as OA2, and the site PHP memory limit is 256MB — so I thought it might be worth seeking feedback from you. The php-error log shows the following errors: [23-Aug-2014 23:16:00 UTC] PHP Fatal error: Call to undefined function field_info_instances() in /srv/bindings/…/…/profiles/profile-name/install_from_db/install_from_db.profile on line 182 [23-Aug-2014 23:20:54 UTC] PHP Fatal error: Call to undefined function field_attach_load() in /srv/bindings/…/…/includes/entity.inc on line 316 I apologize for seeking assistance in a blog post comment; but I believe this might be helpful to others who are impressed with the OA2 approach and having difficulty adapting it. Any suggestions are appreciated. Thanks! Mike Potter You’ll want to look in your MySql error log. When this thing fails, you’ll get all sorts of weird PHP errors because Drupal can’t bootstrap itself when missing some of the DB tables. The only issues I have run into is 1) if your DB user doesn’t have the LOCK permission in MySQL it will fail to clone the tables, and/or 2) if the max_allowed_packets in MySQL isn’t set to a larger value such as 32M then some of the DB imports will fail. Donovan Dilon Thanks Mike, I’ll look at the MySQL logs. Your reply and responsiveness are much appreciated. RyeSeronie ok so this seems to be the most recent thing I can find about Atrium. I cannot find anything explaining how to get atrium up and running. Do I install drupal first or is atrium its own installation; if so do I just copy the files over or do I install it using the drupal module installer… for something so great I can’t seem to get an answer from anyone! Mike Potter Open Atrium includes Drupal. So just go to http://drupal.org/project/openatrium and click on the 7.x-2.18 tar.gz or zip link at the bottom of the page to download it. Unpack it to a directory in the root of your web server. Then in your browser enter your hostname/install.php to run the installer. More information on installing and updating is found here: https://drupal.org/node/2169701 Jake Schlachter Mike, this is a great idea. I’m using Barracuda / Aegir to manage my OA platforms. Any thoughts on how this will / will not interact with the Aegir automated install process? moshe I’ve been longing for the old ‘import from database’ days as I wait eternally for Drupal 8 to install. I agree that this makes sense sometimes. Aslan Kanzas Mike, this is really great! Thank you very much for your ongoing contributions. Alex’ idea of demo content would really ice this cake – making it really easy to communicate the value of OA to new users. Demo data would also be great for new users to get a feel of how to build their own system, without getting lost in the myriad of awesome options that may be used to do so. Do you have any plans on adding demo data e.g. a demo University OA setup? Let me know if I can help. http://www.waqasnasir.com/ Waqas Nasir I tried both options of normal installation and this quick recommended one. I am on Bluehost with PHP 5.4. On both of the options at the last step where we define the admin and admin email and time zone, the page ended up and blank white , i tried to refresh the page but same result … Anyways when going to the base URL of the site, the site seems to be functional and i can login as admin as well … I am not sure if i only missed the “thankyou for installing success message” , OR something else as well .. http://brightsolutions.de ManuelBS Thanks for this amazing Idea! I really thought about this way to install distributions much quicker but I didn’t try it yet. Now as you confirmed it works, i will definetly implement this for ERPAL for Service Providers (http://drupal.org/project/erpal). As we develop ERPAL Platform (http://drupal.org/project/erpal_platform) as a more light weight Drupal business distribution we decided not to use features because of the missing flexibility and the heavy installation load. The installation process is much quicker. So to given an answer to Alex Weber, yes there are “non feature based” distributions. You can just code the configuration during the installation process using the Drupal API. But, of course, this takes much more time to develop and maintain the distro.. Trout I have tried roughly 20 times to install Open Atrium, in various versions (most listed as the stable recommended versions), on various hosts, and on my local machines. Every single time the install process fails, with errors during install and/or failure loading the main site. I have installed lots of open source apps in my life, I am not new to this. I usually spend a whole day trying to troubleshoot these issues with nothing coming out of it – down the rabbit hole of looking up forums, Drupal project page issue tracking, and anywhere there might be information. I’m really shocked there aren’t any installation issues currently shown in the queue. It makes me think I’m doing something wrong, but with the sheer number of attempts and so many variations (hosts, versions, config variations to troubleshoot, multiple attempts erasing the database, restarting apache and starting again) I find it hard to conclude anything except that this software simply isn’t any good. I keep trying because I need what Open Atrium promises, and I can’t find a discussion that clearly go into all these install issues. I’m inspired by your direct and honest explanation of these issues in your post, but I’m tired of never getting this to work. (As I said, I’ve installed many packages in my life without this level of problem.) Any help with resources to solve these issues would be appreciated. After 2 years of trying, I’m going to give up for good and look for a better more robust solution, that at least strives for an install that works.