App::Flo : Reclaim space used by duplicate files

Once again I have to handle the same situation : no more spaces and directories with a lot of duplicates.

That's not the first time I have to do it
(last time it was to remove all the duplicates .mp3 with different names when I merged my various 'Music' directories from different boxes/disks.), so I already have a small script waiting in my repos.

But this time I choose to explore another way, instead of removing duplicate files, I've tried the hardlink substitution way.

Using hardlinks is not always applicable but my perl5/perlbrew directory seemed a good candidate (read only duplicate data...).
And it was : after running my script on it, the size went from 765M to 670M, and all the test suites of the tested modules passed with all the Perl versions.

I first thought to release the script as a patch for perlbrew, but thinking more about it I realized that a need probably exists for a more generic tool.

That's why App::Phlo was created :-)

Not a killer module, but one that suit my needs, and that will enable me to test some ideas (multi digest algorithms, use with "unionfs like" fs, Perl dirs optimization...)

If you want to experiment with me, don't hesitate : Ideas, patches, comment are always welcome...

Commentaires

Enregistrer un commentaire

Posts les plus consultés de ce blog

Change your Gogs admin password

I might have missed something, but I haven't found any simple way to change my admin password (with emailing not active) in gogs. It was quite easy to find the hash location, but as I didn't know how it was generated... Luckily I eventually found the parameters used, so here it is for you if you need them embedded in a script : var pbkdf2 = require('pbkdf2-sha256'); var key = 'YourChosenPasword'; var salt = 'AnyRandomValue'; var hash = pbkdf2(key, salt, 10000, 50); console.log(hash.toString('hex')); All I had to do was then to update the table user , setting passwd to the generated value (and updating salt with the value used in the script).
Lire la suite

JavaScript for Perl lovers.

Article originally published on  Hello.js This time I feel really qualified to write this article because believe me, I love Perl ! I think in Perl, I dream in Perl, and I really appreciate the whole Perl community. I’ve been in love with this language for more than a decade but I decided that I needed a change. I’ve already said in a previous article why I chose to learn JavaScript this year (instead of getting involved in Perl 6 for example) but let me tell you why you might also enjoy learning JavaScript if you love Perl. Perl developers form a very unified community that all too often, resist outside influences, but learning a second language like JavaScript can really be a very enlightening experience. It’s expressive  JavaScript, like Perl, is an expressive language. You get your work done with just a few lines of code. When talking about programming languages, I really like the tent analogy: In a tent, you have functional things (tent fabrics) whose purpo...
Lire la suite

What is the average salary for Perl programmers in 2020?

Original article published  my new blog   blog.assad.fr If I have no definitive answer on this, the  Business Insider  has some insights: HackerRank polled 116000 developers about their salaries and got interesting results: Perl is associated with an average global salary of $84,025.50 (54.2% higher than the global average salary) Scala is associated with an average global salary of $77,159.60 Go is associated with an average global salary of $72,691.30 Python is associated with an average global salary of $56,670.90 JavaScript is associated with an average global salary of $55,690 Without more information about the polled panel it's hard to state this results as “Truth” but they seems to confirm personal beliefs: The salary is more linked to the scarsity of resources than to the trendyness of the associated technology. Perl resources are less and less available. You know what ? It's good to be a Perl programmer :-)
Lire la suite