Avatar

Patec

@patec / patec.tumblr.com

Avatar
reblogged

Bad news, I’m having some problems in my life and I hate to say that, but I’m in need of money. I can’t do commissions, cause it takes me a lot of time for that. If I won’t have enough money in the near future, then I’ll probably won’t be able to draw for a pretty long time. So i kinda need some advertisement for my Patreon https://www.patreon.com/ELZZombie?ty=h Here’s a little preview of NSFW picture. The original sketch was made by @heavymetalbronyyeah . He allowed me to resketch it and post it on my Patreon. Thanks a lot man! His picture should be done soon, so I suggest you to follow him, cause his picture will be pretty cute and sexy.

Avatar

up! It's happening! I am doing it to see how much I can improve.

And here are the rules!

-Share this journal and you'll get a number!

-link me the journal and the reference of your oc in the comment below

-one oc per person

-tell me the expression you want

This is all ^^ Thank you!

(if many people will be interested I'll add more spots, plus I'll start uploading after all spots are taken)

Avatar
reblogged
Avatar
derpinews

Progress

Okay, a quick progress report on the move so far.

There’s a lot of steps to moving Derpibooru’s core database because a lot of the data structures aren’t the same, or are stored differently, and need translating. The most obvious is that MongoDB uses a BSON timestamp identifier whereas PostgreSQL (by default) uses numeric IDs. While we could bodge PostgreSQL into using Mongoid’s IDs, it’s much neater in the long run to migrate everything once.

So: We’ve got the data out of MongoDB and into PostgreSQL. That’s the easy part (we’re using a lovely tool called mosql, though we’ve hacked it about a bit). Next up is doing all the translations and consistency fixes to make all the IDs line up - this involves a lot of lookups to build new ID arrays on things like images and filter/user records, for instance. This is the most time-consuming part of the process and we expect this to take many hours. Once that’s done we’ll have a bunch of work to do to check the data and make sure everything went well; then we’ll shut off the site entirely while we do the final migration of application code; the site will be back in read-only mode while we verify that and then we’ll be ready to turn the site back on properly.

There’s so many unknowns here that I’m wary of giving even vague estimates for timing. Safe to say we’re working on it as fast as we can (and by we I almost entirely mean byte[] who has been slogging through this work like a champ while I hide in bed with a crappy cold, venturing out when some bits only I can do need doing) and we’ll have it all done as soon as we can manage. I’m optimistic we’ll have the site live again on Wednesday on the new database, but we’ll see!

Clover

Avatar
reblogged
Avatar
derpinews

Engineering for the future

Derpibooru’s been around for about 4 years now, and starting to mature as a site. We’re not implementing as many new features, especially when it comes to the core of the site, and we’re spending more engineering time on improving what we’ve got instead of adding new things.

Back when I first started writing the site, I wanted to avoid a lot of the issues that plagued other image board software. That required a fundamentally different data model, and at the time, MongoDB was the only option. I picked MongoDB as the core database for the site, and we’re still running on it today, albeit with ElasticSearch running alongside it to answer search queries. An average page load on Derpibooru will talk to ElasticSearch once, especially if there’s more than one image on the page, and MongoDB maybe 10-20 times, depending on the page (though we cache many of these).

However, with a million images in the database, over 100,000,000 user interactions (votes, faves, etc) and so on, we’ve been stung by MongoDB a few times. It’s not as fast as a traditional database for a lot of the queries we’re using it for. And it’s got issues with concurrency and consistency, which makes engineering certain aspects of the site difficult, and has lead to extended downtimes while we fix things. It’s becoming increasingly problematic at larger scales, causing us to move more parts of the site to ElasticSearch (forum post consistency is a result of this).

For the last year we’ve jokingly discussed moving away from MongoDB - it’s a huge amount of work - but last month byte[] (liamwhite1) actually started to sit down and port the software running the booru to use PostgreSQL, our selected ideal database. PostgreSQL has recently added support for the data model we’re using in MongoDB, namely arrays, so it’s an ideal fit for most of our work. It won’t replace ElasticSearch, but it’ll entirely replace MongoDB, improving performance, reliability and consistency in most of the site’s core.

This work is now almost complete, and we’ve spent some time planning how we migrate the site. This is by far the largest change to the site’s codebase since we introduced ElasticSearch around the time Ponibooru was closed. The work is far-reaching and has impacted practically every part of the site, so we’re anticipating there will be problems, and that we’ll need some time to fettle and fix them.

We’re going to need to turn everything off for a day or so while we move all the data across, and we’ll then need a bit of time to verify and validate. We’ve implemented a read-only mode so we can keep the site largely afloat during much of this time.

We’ll be starting this work on Monday, the 23rd of October and anticipate that it will be entirely complete by Friday. With luck and care we’ll be done much sooner than that.

tl;dr We’re getting rid of MongoDB, how ‘bout that, but babies, don’t you panic, by the light of the night it’ll all seem alright, we’ll get you PostgreSQL instead. Site’ll be a bit rocky next week.

Avatar
reblogged

A print to maybe sell at cons? What do you guys think? Would you want a mad pinkamena on your wall?

Avatar
patec

doooooont stooooohhhp!

Avatar
reblogged

Done during one of my livestreams, yay :D

Avatar
reblogged
Avatar
foldeath

For sketching!

Hey, okay guys.

Give me some ideas what kind of grimdark art would you like to see from me? Be creative, think dark, maybe something wicked or sinister. Or maybe completely insane! I will sketch something on paper tonight and post pics here. :3

Avatar
patec

Hmm.. some character hanging dead or close to death in a fence of barbed wire or something similar with sheer terror in it’s eyes.

Avatar
reblogged

Final exams are coming so I’m going on a mini hiatus!

Don’t worry this will be a very small hiatus until all my studying and testing is done, I’ll be back mid-May! So just gimme a month, pretty please! 

So during this month of no tiredpie updates I’ll do an art giveaway! So it’ll be like I wasn’t even away that much at all!

Rules:

-You don’t have to be following me

-Likes and Reblogs count as entries each

-Reblog as many times as you want!

-No giveaway-reblog blogs

-Let’s make the end at April 28th at 5pm EST.

You can read the below to see what specifically I can draw for this giveaway.

Avatar
reblogged
Avatar
foldeath

Rough base sketch out of second unit done!

Shock party incoming!

Avatar
patec

A shock party?

I bet it's gonne be batterific!

Watt will we do you ask? Dace and sing and laugh until it hertz! 

Now give up your resistance and join us, look how ex-static everyone else already is! 

- I'm sorry -

You are using an unsupported browser and things might not work as intended. Please make sure you're using the latest version of Chrome, Firefox, Safari, or Edge.