Physical Raws

From Yuri Project
Revision as of 23:53, 7 December 2024 by Treefroog (talk | contribs) (Initial content on how to do physical raws)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Physical raws, or physical scans, are raws that are taken from real-life pages and scanned to a digital file. While the name "scanlation" is taken from this practice, it has mostly fallen out of use due to the proliferation of digital raws. This page will go over the process of how to scan in physical pages and the best practices for doing so.

Physical raws have challenges associated with them that digital raws do not. The two largest difficulties are color calibration, and page alignment. With digital raws neither are an issue since they are directly exported from the author's editor.

Preparation

  1. If it is possible to use digital raws DO SO. Physical raws require much more effort, and the final result is lower quality. The first step is to make sure it is your only option.
  2. Acquire the raws. Either buy at a store, or order online.
  3. Inspect the booklet, specifically how it is bound.
    The main two ways physical raws are bound is by stapling a single signature, or by gluing together many signatures into a volume.
  4. Decide how to scan
    There are two primary ways to scan pages. One is to crease the book open on each page, and scan the pages. The other is the remove the pages from the binding. The latter results in higher quality scans as there is zero gap between the page and the scanner surface.

Unbinding

If unbinding a volume, there are several ways to go about doing so.

If it is a one-signature work, then it is most likely stapled. If that is the case, then just carefully bend the staples so they can be removed.

If it is glued, then the volume will have to be heated to soften the glue, then the pages removed. There are several ways to go about this:

  1. Oven

This technique involves pre-heating an oven (or toaster oven) to its lowest possible setting, then placing the volume in the oven for around five minutes. After that, the glue should be very soft.

  1. Heat gun

A heat gun is ideal, but a hair dryer may work. This technique involves heating the spine of the volume until the glue is soft.

  1. Microwave

This technique involves microwaving a volume to soften the glue.


Regardless of the technique used, it should be noted that the glue will harden fast enough that it will need to be heated several times. Patience must be used, and care must be put in to ensure that glue does not get everywhere. When interacting with the softened glue it can and will form very thin strands, and stick to any paper is comes into contact with. This should be minimized as much as possible.

The first step is to pull the cover off. The recommended way of do this is to wait until the glue is soft, then place the spine down on some parchment paper. Then holding the cover down on the paper, pull the pages up. This reduces the chance that glue will get on the pages themselves, and the glue strings will just get on the inside of the cover.

Next, the signatures should be individually pulled apart. To do this, first identify where the signature are. They will most likely just be a glued together collection of pages, and not physically connected like a hardcover volume would be. It should be clear by looking at the spine of the pages and how they are grouped where the signatures are. Once identified, soften the glue, then with the pages on a piece of parchment paper with the last page face down, hinge the first signature up and over the spine, and pull it apart from the rest of the pages. This should prevent any glue strands from getting on the pages. Repeat this process for each signature.

Finally, the above process should be followed, except for the pages within each signature.

Scanning

The process of scanning is relatively simple, but attention to detail is required. The more effort put in to the scanning of a page, the higher quality the final result will be.

  1. Clean the scanning bed
    This minimizes the dust and dirt that will be scanned. This should be done every few pages. A microfiber cloth works best.
  2. Place the page on the scanner bed as straight as possible
    It will not be perfect, but this just minimizes the amount of adjusting needed in the next step
  3. Place a black piece of paper to back the page.
    This ensures that the opposite side of the page does not bleed through when scanning.
  4. Do a preview scan. All of the software should have a preview option available
  5. Identify the longest straight line in the page itself.
    Do not use the edges of the page as a straight-edge. Often pages are not aligned with the manga itself.
  6. Rotate the page to make the identified line as straight as possible.
  7. Run another preview scan. Repeat the above step and this step until satisfied.
  8. If a page has no straight line, use the page edges as a best-effort straight-edge.
    Set the scanning DPI to 400-600 DPI. If a color page 800 DPI can be used as well.
    Set the output to be grayscale if a grayscale page. Set the highest bit-depth that can be used.
  9. Crop the scan to slightly outside the border of the page. Around a 5mm margin around the page is sufficient.
  10. Scan to a lossless file format. TIFF is the most common scanning software supports.

Hardware

The hardware used to scan in pages is not as important as it may seem. Any scanner will do an adequate job. Get the cheapest printer/scanner combo at Wal-Mart and it will work fine. A recommendation for decent hardware is the Epson V500 scanner. This can be obtained on eBay for around $40-$50.

Software

What software is used for scanning in the pages:

Included scanning software
This is the scanning software that is included with the drivers for a scanner. This works, but may have some automatic corrections that are applied and unable to be disabled.
IfranView
This is a good piece of free software for batch scanning. Works well, the only downside is that not all scanner drivers are compatible with it. This is the first-choice if the scanner being used is compatible with it. For a scanner driver to be compatible, it must have a TWAIN API library available.
VueScan
This is paid software, but works well. The free version does work, but places are large watermark over the entire image, so is not usable for scanlation. The main benefit is that is uses its own custom drivers (on top of the manufacterer's hardware driver) to ensure that the output is the raw scanner output.
Silverfast
An alternative paid solution for scanning. There is not much reason to use this over VueScan if paying, but it also works.

Color Calibration

The process of color calibration is a best-effort attempt at matching the color on the physical page, to the color displayed on a color calibrated screen. Scanners do capture a perfect representation of the pages, and they all must be adjusted. For grayscale pages this means adjusting the output level transfer function. For color pages this means adjusting the output curves for each color channel. This is mostly an art, but they are processes that can be used to minimize the amount of guesswork.

Note that this should ideally be done using non-destructive filters. In photoshop these are known as adjustment filters. Importing the raw scan as a smart object so that it is immutable, then applying nondestructive transformations a good workflow.

The one destructive operation that should be done is changing the colorspace of the image from RGB to grayscale if the image is RGB. This should be the very first step done when importing a scanned image.

Manually

This should only be used as a last-resort. This is when the physical page is compared by eye to adjust the transfer functions. In the ideal case for this the user has a properly color calibrated monitor, and a lamp that outputs all light wavelength equally such as sunlight or a tungsten lamp. After that they adjust the output transfer function until the image on their monitor matches the physical page.

For grayscale pages there are three parameters to adjust: the blackpoint, the whitepoint, and the graypoint. The interface for adjusting this is the histogram of the image. The X-axis of the histogram is each possible pixel value from 0 to 255. The Y-axis is the number of pixel in the entire image with that value. For a grayscale image, there will often be two clear peaks: the black portions of the image, and the white portions of the image. These are spread out across several values due to imperfect scanner lighting, and sensor noise.

The white point should be on the lower side of the white peak, and the black point should be on the upper side of the black peak. Adjust these clips any value input from the raw scan above for the white point, and below for the black point, exactly 255 and 0 respectively. It is a good idea to find a page with large amount of solid black and solid white sections, as well as a large gradients. The gradients should be inspected before and after the application of the clipping operation to ensure detail is retained to an acceptable degree. It may not be perfect, but as much detail as possible should be preserved, while binning as much noise as possible from the solid sections. Comparing with the physical pages is a good idea at this stage.

To adjust the graypoint, first identify a gradient section. Then compare that gradient with the physical page. Adjust the graypoint until the relative contrast of that gradient with the surrounding details matches the physical page.

Color is much more complex. Rather than using a levels transfer function it uses a curves transfer function. This is the same concept, but allows more control on how the inputs are mapped the to the outputs.

Page Alignment

TODO