Migrating My Nextcloud Server to Another Server

Jason Anderson 2 Comments

When I saw that my version of Ubuntu could not be upgraded any more (due to Digital Ocean’s system), I had to migrate my Nextcloud installation (version 11.0.2) to a newer version of Ubuntu (16.04). In the documentation for Nextcloud, it details how to exactly migrate your Nextcloud installation to another Linux server, so I tried using that. Sadly, though, they left a couple of things out. So here’s my version of how I migrated my Nextcloud installation to another server.

First of all, they say to back up your data, which is what I did (to some extent). Next, I spun up a droplet which had similar specifications to my previous installation (it uses 512MB and has 20GB of storage, for instance). I made sure to put in my usual ssh key for this new droplet, as well as securing it in other ways. At first, I thought I knew how to easily do this: copy over the /var/www/nextcloud directory to the new server (which was also set up for Nextcloud), change some directory names, and it would be done. However, this was not what I found.

When I tried this method, I couldn’t access the web interface. What was worse was that I had forgotten to change the firewall configuration on the new droplet and accidently “locked” myself out. So, through some more research, I tried it again with another droplet.

This time, I copied the files using rsync, and made sure that I used the proper switches (I used the “-a” and “-t” switches, in order to archive the files, as well as save the timestamps). I saved the files to a new directory on the server, and made sure to back up the old files. I thought that this time I had fixed the issue. But Fate can be cruel.

Even though I had copied over the files in the “correct” fashion, the server still wasn’t accessible from the web. Looking at the /var/log/apache2/error.log file, I found that the webserver couldn’t start due to Nextcloud not be able to read the database. After researching the problem more, I learned that the data can’t be just “copied” over; rather the data has to be copied, and the database has to be imported. So, after scrapping that droplet (I had changed it too much already), I spun up a new droplet, and tried this whole thing all over again.

First, I put the server into “maintenance mode” and stopped the Apache server. Then I extracted the data from the database (via the command mysql -u ownCloud -p password ownCloud > /tmp/dump.sql), copied that over to the new server, and imported it into the new database. For importing the new database, I “dropped” the old database, created a new one, and finally imported the data with the command mysql -u nextcloud -p password nextcloud < /tmp/dump/sql. Then I copied the old Nextcloud as I did before (using the official documentation’s recommendation of the command rsync -Aax) and carefully moved the files into the new /var/www/Nextcloud directory. Even through all of this, it still wasn’t enough.

Looking again at the /var/log/apache2/error.log file, I found that the new Nextcloud install couldn’t read the database due to the new server using the old Nextcloud config.php file (are you still with me?). So, I changed a few values in the config.php file so as to use the new database. What I did was change the dbname to the name of the new database, as well as input the new database login information. Also, I added the new IP address to the “trusted hosts” array in the config.php file. This seems to have fixed most of my problems.

Just in case, I also ran a script that I found in the official Nextcloud documentation for fixing the permissions on the new server. Then I changed some of the security configurations for the Apache server. I copied over previous configurations for SSL into the /etc/apache2/sites-available directory, and enabled them through the a2enmode command. With all that finished, I started up the Apache server again, and took the Nextcloud installation out of “maintenance mode”. Finally, I was able to use the server. Except, it wasn’t exactly to my liking.

You see, I had copied over the “data”, “config”, and “themes” directories. I did not copy over all of my previous apps. When I saw that I had only half of my previous apps, I thought, “I need to fix this,” and copied the contents of my previous Nextcloud’s “apps” directory to the new server. With those out of the way, I saw to using some of Nextcloud’s recommendations, and bumped up the memory (as well as putting in a timeout feature). These were harder to fix, partially because I had these problems with my previous Nextcloud installation. Nevertheless, I sought to fix them.

One of my problems was with the /var/www/nextcloud/.htaccess file, specifically that it wasn’t working. To fix this, I edited the /etc/apache2/apache.conf file and changed the AllowOverride directive for the /var/www section to “All”. This allowed the /var/www/nextcloud/.htaccess to work (at least, it would work since I’m accessing the site over a secure connection). Next, I added a memcache so as to speed up performance. I added in php-apcu and edited the /var/www/nextcloud/config/config.php file to reflect this by assigning memcache.local the value \\OC\Memcache\\APCu. My server was made much faster with this tweak. For added polish, I followed the directions on this tutorial and added Redis support.

This was a tough migration that I thought would have been easy. I figured that it would have taken a couple hours. However, it was stretched out to a numbers of hours (not to mention one night). While it’s great that I have migrated to a more manageable configuration, I should have done more research.

Helping Out a Local Charity

Jason Anderson Leave a comment

I’ve been helping out a local charity with preparing tax returns for the needy and underprivileged for the past few weeks and we’ve run into a problem. Each time we have to print out the tax returns for the clients, we have to take the laptop over to the printer to have it printed out.  This takes a while, and it can be a royal pain.  So I have suggested setting up a small print server so that the laptops on the WLAN can easily print.  My initial set-up looks encouraging: I have set up a Raspberry Pi as a little print server, and have successfully printed from one of the laptops.  With some security measures and other set-up, the other laptops that the tax preparers are using will be able to use this print server, too.

Learning About Setting Controls for I.T. Assets

Jason Anderson Leave a comment

In my pursuit to get into the information technology (IT) audit field, I must learn about setting controls for securing IT assets, minimizing risk, and eventually testing that said controls work.  In major organizations where information flows constantly and is utilized to advance the organization’s goals, ensuring that the information and knowledge are accurate, intact, timely, and secure are important.  To secure them, though, management must know how this information and knowledge can be lost.  Once they understand this, controls must be put into place so as to prevent this loss.  But management cannot always safeguard these assets.

As a company moves along in its financial year, these controls can break down.  For example, backups can be corrupted (losing information), and employees may leave the company (thus losing knowledge).  So it is also good to reassess whether these controls are working as intended.  This is where the IT auditor steps in, to evaluate these controls, and see to it that that continue to do the job.

Though I know of some ways of testing these controls (e.g. vouching, interviews, and walkthroughs), I have never carried them out.  All I have done is study them.  While studying textbooks is fine, some would say the true teacher is experience, and I have not done so.  For the most part, I have managed a couple of websites (this one included) so that they cannot be hacked.  I have put controls in place to ensure that my website is not compromised.  But to make sure they work, I must turn to someone who has had experience in managing a website.  Not just that, but an IT auditor who will teach me what to exactly do so that this website is not damaged.  Eventually, I would learn more from them so that, when I am on an audit engagement, I can ensure that the company’s valuable assets are kept safe.

MyCroft, AI, and how I’m trying to help it

Jason Anderson Leave a comment

The other day, I saw that a version of MyCroft was released for the Raspberry Pi.  I have been following MyCroft for a while now (mostly through the Linux Action Show) and have tried using it.  The software is still in beta, so I found some bugs with it, namely I can’t really use it.  I have tried pairing it, then talking into it with my microphone.  But it can’t understand what I’m saying.  At first, I thought it had something to do with getting a secure connection to the MyCroft backend servers.  Now it could be a problem with my microphone.

I’ll admit that my desktop microphone isn’t the best.  But how much clarity does the microphone require?  Apparently, a lot.  The microphones on the Amazon Echo, for instance, can pick up a bunch of channels of sound.  So it looks like I’m going to have to get a better microphone.

What I’ve also seen is that MyCroft uses Google’s backend for the speech recognition.  It looks like they’ll go to something such as Kaldi, but that doesn’t have a large enough speech model to get the job done.  While it has a model based upon over a thousand hours of speech, it may require thousands of more hours of speech just to get better results.  I’ve been donating to Voxforge and trying to help with their speech corpus.  However, they’ve barely got enough for half of their first release.  So I was wondering how to speed things up and get them more samples.

What they could do is make it fun and interesting to donate.  I was thinking of something like a badge system on the Voxforge website, or even leaderboards.  Then again, would this make it fun to donate?  I need to think more on this.

Interesting video on designing programming languages

Jason Anderson Leave a comment

Yesterday, I started watching this video on programming languages, and it took me over forty minutes to stop watching the video. It’s not because that the video was over an hour long, but rather the subject matter of the video.  It’s a presentation by Brian Kernighan titled “How to succeed in language design without really trying”.  The presentation by professor Kernighan was very well done.  He went through a bit of history with how some programming languages came about, as well as their usees.  He also talked about his time with Bell Labs, and how he, along with two other great programmers, wrote the language awk.  The video had me interested because, for one, I could understand half of what professor Kernighan said, and two, he admitted that he threw the language together out of necessity.  Also, he would, at times, remind the audience of his short comings, such as with functional programming languages, and remembering how to program in C.

Made My Own NES Classic Console

Jason Anderson Leave a comment

It looks like the NES Classic is sold out every where, and there are scalpers on eBay trying to bilk old fans out of their hard-earned coins.  Now, I don’t want to get an NES Classic on account of owning a couple of the featured games, as well as owning them on the Virtual Console.  But since the lack of want doesn’t stop me from tinkering, I made my own.

It’s quite easy to make a tiny device which can emulate and play NES games; it’s already been a reality for a long time.  In my case, I took a Raspberry Pi 3, got the official Raspberry Pi touchscreen, a case to contain these parts, an old SD card with an install of RetroPie on it, and a Classic USB NES controller.  And just for shits and giggles, I also hooked up the whole thing to a 20Ah battery so that I can play it on the go.

Frankenstein’s fun machine

This was a fun little project, but it does have its setbacks.  The Raspberry Pi, along with the other attachments, draws a good amount of current, and so has a problem with voltage (that’s the reason it has two USB connectors).  Also, if you want good sound, you’ll have to use a different sound output; the on-board audio jack is terrible.  Then there’s the price: this little beauty set me back around $200.  So while the NES Classic will set you back $60, at least that’s an official machine, and has a few bells and whistles.  Still, this device is easily configurable, and I can add as many games as I want.  So it not just plays NES games, but also SNES games.

Dealing With the Internet of Things

Jason Anderson Leave a comment

The other day, I attended a meeting of the North Texas chapter of ISACA.  There, the information technology veteran, Austin Hutton, gave a presentation on the dangers of the Internet of Things (IoT).  I have written about the IoT and how it can be used to devastating effect.  One of the problems that Hutton talked about is that there are more IoT devices than there are people on earth.   Thousands are being manufactured and sold each day, and each one of these devices can be hacked to assist in an attack.  And the problem is getting bigger.

Most of those devices were poorly designed, and thus have no way of being updated.  The companies who make these devices have thin profit margins, so they cannot afford to make them secure.  In some cases, the manufacturer buy the chips from other companies, so they are not directly responsible for its security.  The average IoT device can be easily hacked: a number of them have easy to crack passwords, or have flaws that were not detected when they were being designed.  There are even programs which can auto-hack some of these devices.  All the hacker needs to do is learn the make and model of the IoT device, select the program, sit back, and gain control over it.  For those devices which are used as intended, they may be doing something illegal.

Hutton gave the example of a Tempur-Pedic bed which can send the user’s data back to Tempur-Pedic for analysis so as to improve the user’s experience.  He then gave an example of someone else (specifically, his 14-year-old granddaughter) sleeping in the bed, and their data being sent to Tempur-Pedic without their permission.  This can be considered breaking the law because she’s a minor.  How would that situation be resolved?  How can we at least minimize the damage from IoT devices?

For one, education.  Though companies are really selling the convenience of IoT devices, consumers must learn how harmful IoT devices can be.  The public needs to learn that these devices can be used to cause harm to our cities, and possibly to themselves.  Recently, the business of a utilities company in Finland was disrupted due to a DDoS attack, resulting in the heating for their customers being disabled.  What if this was the smart thermostats of many of their customers getting hacked?  The attacker could lower the temperatures in these houses, or disable the thermostat, which would be a dangerous situation to homes in Finland during the winter. How else could these devices be attacked?  An attendant to the meeting, David Hayes of Verizon, had one other scenario.

There are utility companies in North America and Europe that use monitors called SCADAs which can remotely control machines vital to a functioning city (one example is the water pumps which keep drinking water flowing through the city).  What if, Hayes suggested, a hacker takes control of these pumps, and threatens to take them offline, or even increases their work to the point of destroying them, unless he is paid $100,000?  Now we’re starting to see the cost of this problem.  This cost will only increase, as malicious hackers devise ways of misusing these IoT devices.

Another way we can minimize the damage from IoT devices is to ensure that your IoT devices can be modified such that only you can control it.  If you can change the password, do it.  Check that a default root password hasn’t been hardcoded into the device.  If you can, find a device that can be updated (though few IoT devices have the capacity to be updated).  On the government side, we’re going to need some form of  oversight.  For instance, no IoT device bought by  the government can lack the ability to be updated.  How about current IoT devices?  There is little we can do about them.  If we’re dependent on them, then it’s going to be difficult to replace them.  Maybe for the average person it’s easy to change their IoT lightbulbs.  But how can a maintenance manager at a company tell his bosses that, due to the threats these IoT devices have to the security of the company, they all have to be changed.  How much will that cost?

This is a growing problem that will grow more as these hacked IoT devices are used to facilitate these attacks.  It is imperative that this problem be addressed now, rather then have some catastrophe occur, and involve the lives of thousands.

Wondering About Risk Assessments

Jason Anderson Leave a comment

Since I have little knowledge on audits (only from what I learned in college), I have been reading up on the finer details of an audit.  I came across this documentation on the methods of carrying out a risk assessment in an audit.  The article lists three options for performing a risk assessment (though there are many ways of performing a risk assessment).  One way of doing it is by having an outside consultant coming in, looking at what the company wants to accomplish, analyzes the business processes, and determines what their exact risks are.  Another way of doing it is for a consultant to come in, work with management to identify risk, determine the level of risk to the company, and evaluate the controls in place.  The final way, as detailed in the article, is to have an assessment performed by many employees in the company, identifying the possible risk, ensure the controls are in place, and monitor whether the controls are working.  This, though, is meant for an audit of the financial statements.  While it’s true these methods can be used to audit other parts of the company, these are mainly for ensuring that the financial statements are reasonably correct and free from errors.

So how could I apply this to an I.S. audit?  The first step on an engagement is setting the scope and the objectives of the audit.  Then you move on to the risk assessment.  Where to use these methods will depend upon how the company operates, and on the inherent risk to the company.  If the company is more “top-down”, and things are usually dictated from the top, then perhaps it would be better to have a consultant come in, talk with management to identify risk, and perform more assessments from there.  A problem with this, though, is that you may not get buy-in from the lower employees.  At least, that’s what I can tell from such an approach.

As for other methods, well, I’m going to have to eventually learn those in detail.

The Nintendo Switch™: Is this the success Nintendo needs?

Jason Anderson Leave a comment

So Nintendo has shown off their next console: the Nintendo Switch™.
This machine is a touchscreen with detachable controllers called Joy-Cons.  What a user can do is either play it while the device is connected to the TV, or take it out of the dock, and play games on the go.  The device has a number of controller options, including using the Joy-Con controllers, using a Nintendo Switch Pro controller, and just using the touchscreen.  The whole display will  be in full high-definition, and will probably support multi-touch capabilities.  It has been reported that the device has an nVidia Tegra GPU in it, so Nintendo has switched (no pun intended) to a new graphics card maker, and has moved on from ATI/AMD. It also looks as though the device supports cards similar to those used in the 3DS, but I’m sure it has on-board storage, as well. Now I need to ask the question: why should I care about this device?  I already have a PC which can play a number of games quite easily (maybe not the most recent games at the highest settings), as well as a good mobile phone and tablet. So for the most part, I’m not interested. There is a good number of publishers who are saying they will support the Switch. But what will they actually release on the device?  My guess is that, at first, they will release ports for the device (or games that have been remastered). But then what?  Would Bethesda release the next Elder Scrolls game on the Switch? It’s unlikely, considering that they’ll probably release it for the PS4 and Xbone, and of course they’ll have a PC version.  Maybe they’ll make a smaller version, or perhaps they’ll release the mobile version on the Switch.  If that were to happen, though, why would anyone care?  Couldn’t a user just play the mobile version on their phones or tablets?  How would that version be different? Bethesda may release an Elder Scrolls game on the Switch, but it won’t be a version that’ll be found on the other consoles, that’s for certain.

How about other parts of the device?  Will it have specs comparable to the PS4 and the Xbone?  Probably, however those two consoles already have upgraded versions on the way.  It’s true that they won’t be huge improvements over the originals (supposedly, the PS4k will have support for 4k televisions and be capable of running most games at 60FPS.  But that’s it), but they still have
specs that some big developers will like.  How about the development environment for the Nintendo Switch?  Can one easily take their Steam game and port it over to the Switch?  There were a big number of indie developers who really wanted to port their games over to the Wii U.  But the hardware was just too foreign from their familiar hardware to justify a port.  Thankfully, a number of games (such as Axiom Verge) did make it to the Wii U.  But is this enough to keep the new console afloat?

Among other big developers who have pledged support include the old vanguard of Sega, Capcom, and Square-Enix.  These three are laughable, as they have been hemorrhaging money for years.  Sega has lost millions over the past few years (though more recently they have rebound), Capcom has only been kept afloat by Street Fighter, as well as old re-releases of Mega Man and Resident Evil, and Square-Enix has seen marginal return on their mobile phone offerings (don’t even get me started on Final Fantasy).  What are they going to release on the Nintendo Switch?  How are they going to take advantage of the device?  Probably in the same way as the Wii: release only a small number of games, some re-releases, as well as “test” games, and see whether they are a success.  So it’s unlikely we’ll see some big games from these developers (although the remake of Final Fantasy 7 does not seem far-fetched.  Twenty years too late, is what I think).  Other developers include Konami, Activision, and Electronic Arts, but I really doubt they will release anything worthwhile on the Switch.

There are other developers who do look promising.  Platinum Games is making something, and with their track record with Nintendo, they’ll probably make some great content.  Others include From Software, but my guess is that they’ll port over Dark Souls or Bloodborne, so nothing new there.  Another developer on the list is Nippon Ichi, most famous for their Disgaea games.  What they’ll have is anyone’s guess.  Then there’s Epic Games.  That one is a bit of an enigma: why would they develop for the device?  Why would they care?  I have not a clue what they would make for the Nintendo Switch.

All of this information is wonderful, but the public needs to know other things. As I have mentioned, it needs to have specs similar to the competition, so what the final specs will be is unknown.  How will the games be played on it?  Will they all use cards, or will discs be supported?  What are the online capabilities for the Switch?  Since this is Nintendo we’re dealing with, we know it won’t be as good as the competition (probably little voice support, a gimped messaging system, and no online friends group support).  I’m sure the Switch will be region-free (even Iwata talked about this), so that will be a welcomed addition. But all of this will mean nothing if the software and feature support is solid.

We’ve seen the list of developers who are supporting the Switch, but what other features will it have?  In time, those will be revealed.  But is this something that Nintendo is showing that they are different, that they will listen to their fans, and possibly make the games that some of their fans want?  It’s impossible to please all of the fans, but there has been huge criticism for major Nintendo games over the past year.  Star Fox Zero was critically panned and Super Paper Mario: Color Splash was also criticized.  Let’s not forget how different Metroid Prime: Federation Force is from other Metroid games. So how is management going to be different for the Switch?  Will they be more willing to support third party developers (and I’m talking about actually throwing
money at them to develop exclusive content for the Switch, as well as helping them with developing the games)?  Will they make their online system more open to those consumers who just want to freely converse and play with other, different users? Will they allow for the users a little bit of freedom in Miiverse, to show content that may be a bit more grown-up?  Of course, there will still be moderators. It is doubtful, as Nintendo’s management has changed little since Iwata’s passing.

I feel that, if Nintendo really wants to recapture the consumers they lost to the competition, they will have to change some of the leadership at the top.  Even though they got a new president, mostly what has changed was what departments the current management looks over (most of the titles changed to “deputy <title>”, so they have a deputy director of marketing.  I guess they became deputies when they got a new sheriff in town).  It’s true that Nintendo has been getting younger developers into their company, and did try to find a younger president.  But their leadership cannot be made up of people who haven’t not been able to turn around their sales over the past few years. “A problem cannot be solved with the same level of thinking that created it,” as Einstein once said.

Is it too early to say whether this will be a big-selling machine?  Possibly.  But if Nintendo’s track record, their current corporate structure, and the list of developers is anything to go by, it’s doubtful that the Switch will be a best-selling machine five years down the line.

Research in Developing a Budget for Video Games

Jason Anderson Leave a comment

Since I like video games, and I know a thing or two about accounting, I thought of writing and recording a video which delves into how the budget for a video game is constructed. I have tried to find out how some major game developers make their budgets, but I have hit a road block. You see, major video game developers rarely give out specific details on how their video game projects are constructed and financed. This is probably due to the reason other studios could steal their ideas, or take advantage of some weakness they may show. It would still be nice to see how a video game is budgeted.

It seems the best I can find is from indie developers. While that is some good insight in how a video game may come together for small-time developers, I would like to see how a large video game developer, and major publishers, figure out the costs associated with development. It looks like that video is going to take a while.