You are here: welcome » dcore » sce-import

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
dcore:sce-import [2016/05/08 06:00] – [sce-import and deb2sce script guide Scripts guide] nitramdcore:sce-import [2016/06/07 09:38] (current) – [sce-import and deb2sce Script Review] nitram
Line 1: Line 1:
 +===== dCore sce-import and deb2sce Script Review =====
 +These scripts are fairly complicated, forum member LichenSymbiont's guide to some of dCore's most important scripts, sce-import and deb2sce.
  
 +The sce-import script is a commandline package manager that calls deb2sce to retrieve .deb files and collect them into an SCE extension. It also calls the update function for the indices of Debian packages (debGetEnv). As you should expect, it must handle the regular Debian and Ubuntu package repository mirrors. Beyound that, it also downloads the dCore specific dependencies, and excluded packages, for the .deb packages (contained in /dCore/$build/import/deb2sce.tar.gz on the FTP). It also contains specific packages compiled for dCore (fltk library, flwm_topside and others).
  
-===== sce-import and deb2sce script guide ===== +An SCE extension is a [[http://squashfs.sourceforge.net/|SquashFS]] file, which can compress data using multiple compression algorithms. 
-The scripts have quite a lot of complicated stuff, without sufficient explinations. +Unfortunately it has one problem: it can't overwrite or delete its stored files -- only create new copies of files. So if a file with the same name exists in the same directory, it adds the new file with "_#" (_1, _2, _3 ...) appended to its file-name. 
-So here is my (LichenSymbiont) guide to the scripts.+So you can't easily update its stored files, without rewriting the whole thing. 
 +But you can add new files to an already created file-system. Detailed information is available in this [[http://www.tldp.org/HOWTO/html_single/SquashFS-HOWTO/|SquashFS HowTo]]. 
 +This allows for the creation of SquashFS files that stores all your favorite programs, in one file, by just incrementally adding them (this is not a feature of sce-import yet). 
 + 
 +These SCE extensions are mounted as [[https://en.wikipedia.org/wiki/Loop_device|loop-devices]] through loadsce (which just uses "mount -t squashfs -o loop..."), and located in the file-system at /tmp/tcloop/. 
 +loadsce also loads all the dependencies of a package.
  
 +**Helpful Links:**
 The scripts uses grep and awk extensively, so you should [[http://tldp.org/LDP/abs/html/part4.html|read more]] about [[http://coewww.rutgers.edu/linux/lessons/lesson9/shell_script_tutorial.html|using them]]. The scripts uses grep and awk extensively, so you should [[http://tldp.org/LDP/abs/html/part4.html|read more]] about [[http://coewww.rutgers.edu/linux/lessons/lesson9/shell_script_tutorial.html|using them]].
 It also uses some more complex awk programs, so you should learn a bit about the [[http://www.grymoire.com/Unix/Awk.html|Awk language]]. It also uses some more complex awk programs, so you should learn a bit about the [[http://www.grymoire.com/Unix/Awk.html|Awk language]].
Line 10: Line 19:
 And understand some pitfalls in Bash (some applicable to Ash): [[http://mywiki.wooledge.org/BashPitfalls|Bash Pitfalls]]. And understand some pitfalls in Bash (some applicable to Ash): [[http://mywiki.wooledge.org/BashPitfalls|Bash Pitfalls]].
  
-==== Summary of the most important parts of the scripts ==== +**[[http://wiki.tinycorelinux.net/dcore:welcome|> Return to the dCore Wiki Welcome page]]**
- +
-sce-import is the command-line package manager (script), which calls deb2sce for getting the .deb files, and collecting them into the .sce package. +
-It also calls the update function for the indices of Debian packages (debGetEnv). +
- +
-As you should expect, it must handle the regular Debian and Ubuntu package repository mirrors. +
-Beyound that, it also downloads the dCore specific dependencies, and excluded packages, for the .deb packages (contained in /dCore/$build/import/deb2sce.tar.gz on the FTP). +
-It also contains specific packages compiled for dCore (fltk library, flwm_topside and others). +
- +
-The scripts are complicated, unless you have a desire to learn, a good general understanding, and/or at least study them consistently. +
- +
-==== SCE packages ==== +
- +
-A sce package is a [[http://squashfs.sourceforge.net/|SquashFS]] file, which can compress data using multiple compression algorithms. +
-Unfortunately it has one problem: it can't overwrite or delete its stored files -- only create new copies of files. So if a file with the same name exists in the same directory, it adds the new file with "_#" (_1, _2, _3 ...) appended to its file-name. +
-So you can't easily update its stored files, without rewriting the whole thing. +
-But you can add new files to an already created file-system. Read about it [[http://www.tldp.org/HOWTO/html_single/SquashFS-HOWTO/|Here]]. +
-This allows for the creation of SquashFS files that stores all your favorite programs, in one file, by just incrementally adding them (this is not a feature of sce-import yet). +
- +
-Then sce packages are mounted as [[https://en.wikipedia.org/wiki/Loop_device|loop-devices]] through loadsce (which just uses "mount -t squashfs -o loop..."), and located in the file-system at /tmp/tcloop/. +
-loadsce also loads all the dependencies of a package. +
 ==== sce-import ==== ==== sce-import ====
  
Line 58: Line 46:
 deb2sce also does the -l option operations, of importing packages from a file containing a list of packages. deb2sce also does the -l option operations, of importing packages from a file containing a list of packages.
  
 +**[[http://wiki.tinycorelinux.net/dcore:welcome|> Return to the dCore Wiki Welcome page]]**
 ==== deb2sce ==== ==== deb2sce ====
  
Line 82: Line 71:
   - And finally, in this big loop, it downloads the .deb file as well, using the fetchDeb() function. And extracts it into the temporary target dir.   - And finally, in this big loop, it downloads the .deb file as well, using the fetchDeb() function. And extracts it into the temporary target dir.
   - And finally, after a lot of operations (a bit too complicated to put here now), it uses mksquashfs to compress the temporary target directory into a SquashFS file -- the sce package.   - And finally, after a lot of operations (a bit too complicated to put here now), it uses mksquashfs to compress the temporary target directory into a SquashFS file -- the sce package.
-\\  + 
-**[[http://wiki.tinycorelinux.net/dcore:welcome|> Return to the dCore wiki welcome page]]**+**[[http://wiki.tinycorelinux.net/dcore:welcome|> Return to the dCore Wiki Welcome page]]**
Print/export
QR Code
QR Code dcore:sce-import (generated for current page)