Processes involved in producing sound and music such as sound design methodology, sound file formats, audio limitations of game platforms, audio recording systems and audio sampling.

Software/application

- Audio Editing

1. Adobe Premiere 

Adobe Premiere Pro is a piece of software designed for video editors who want to improve their work. This desktop app enables users to convert raw video footage into incredibly amazing video products. Adobe Premiere Pro includes a number of tools that allow users to express their creativity and do more than just basic video editing.

They can adjust the colors, fine-tune the audio, and do other things to produce professional-looking results. This software is incorporated with Adobe products, allowing users to transfer their work from one software to another, allowing them to edit and use their finished videos whenever they need to. This simply means that they can work efficiently and effectively to produce an appealing and creative product.

Adobe Premiere Pro's main features are as follows:

·       Projects Run simultaneously

·       Templates for Motion Graphics

·       Project Collaboration

·       VR Audio Editing Effects VR Editing VR Rotate Sphere VR Audio Editing Effects

·       Graphics & Video Titling

·       Transitions

·       Regional Closed Captioning Requirements

·       Labels

·       Type Tool Libraries

·       Multiple Video Formats

·       Publishing on your own terms

·       Various Formats Support

2. Adobe Audition

Audition is a comprehensive toolset for creating, mixing, editing, and restoring audio content that includes multitrack, waveform, and spectral display. This powerful audio workstation is intended to speed up video production workflows and audio finishing while also delivering a polished mix with immaculate sound.

Panel of Tracks

To focus on specific parts of your project, use the Track panel to show or hide tracks or groups of tracks. Create your own preferred track groups and presets for a more efficient and personalized multitrack editing experience.

Music for Auto-Duck

Using the Ducking parameter in the Essential Sound panel, you can automatically generate a volume envelope to duck music behind dialogue, sound effects, or any other audio clip while working on a project. This feature, powered by Adobe Sensei, streamlines the steps required to create professional-sounding audio mixes.

- Audio Recording

1. Audacity 

Audacity is a free audio recording, editing, and mixing application. It also happens to be extremely adaptable. Audacity is used for a variety of projects, including creating music, recording ringtones, and capturing conversations.

Audacity's features include:

·       Recording and playing back sounds

·       Editing

·       Multitrack mixing

·       Importing and exporting of WAV, AIFF, MP3, FLAC, WMA, AAC, AMR and AC3

·       Cross Platform Operation – Audacity works on Windows, macOS, and other Unix-like systems (including Linux and BSD)

2. FL Studio

FL Studio (formerly FruityLoops before 2003) is a digital audio workstation (DAW) created by the Belgian company Image-Line. FL Studio supports audio time stretching and pitch scaling, beat slicing, chopping, and audio editing, and it can record up to 125 simultaneous audio tracks as of version 12.9. A digital piano roll is one of the other standout features. Audio files can be imported or exported as WAV, MP3, OGG, FLAC, MIDI, ZIP, or the native project format. The FLP file extension is used in the name of the file.

Most users of this program will recognize the step sequencer as one of the DAW's "staple" tools. The step sequencer acts as a sort of 'beat-grid,' permitting any sound or sample to be located on the grid and generated as result of a sequence.

Following the creation of a few beat patterns on the sequencer, the user can copy a template instantly to the next step sequencer window (from pattern 1 to pattern 2), keeping all of the stages from the initial pattern 1 sequence but permitting for the expansion on the previous idea in the pattern 2 sequence without having to worry about losing the original idea.

Sound file format

.mp3

MPEG Audio Layer-3 is an abbreviation for "MPEG Audio Layer-3." The Moving Picture Experts Group created MP3 as a compressed audio file format (MPEG). A typical MP3 file has a similar sound to the original recording but takes up much less disk space. MP3 files are typically one-tenth the size of an uncompressed WAVE or AIFF file with CD-quality audio.

MP3 files' small file size and high fidelity aided in the popularity of digital music downloads in the late 1990s and early 2000s. Instead of a 40 MB download for a single song, a comparable MP3 file could be 4 MB. MP3s allowed users to download entire albums in roughly the same amount of time it took to download a single WAV or AIFF file. For more than a decade, MP3s were the most popular format for storing music files on computers and portable music players such as the iPod. While MP3s are still widely used on the Internet, other file formats are now used for audio compression as well.

A header, metadata, and compressed audio are all included in an MP3 file. The header contains information about the audio, such as the encoding version, bitrate, and (sample rate). A higher bitrate and sample rate results in better audio quality, but it also results in a larger file size.

A bit rate of 128 kbps and a sample rate of 44.1 kHz are common MP3 compression settings. This results in a file size of about one megabyte per minute.

MP3 metadata contains information about the recording itself. This information is typically saved in an ID3 tag, which is a standard format supported by the vast majority of hardware and software media players. The actual compressed audio, which is stored as binary data, constitutes the majority of the MP3 file contents.

.wav

A WAV file is an audio file that has been saved in the WAVE format, which is a standard digital audio file format for storing waveform data. WAV files may contain audio recordings with varying sampling rates and bitrates, but they are typically saved in the standard 44.1 kHz, 16-bit stereo format used for CD audio.

The WAVE format is based on the Resource Interchange File Format (RIFF), a file container format that is commonly used to save video and audio. In the early 1990s, Microsoft and IBM collaborated to create the WAVE format, which became the primary option for saving raw, uncompressed audio in Microsoft Windows.

.aac

Similar to an.MP3 file, but with several performance improvements; for example, higher coding efficiency for both stationary and temporary signals, a simpler filter bank, and better handling of frequencies above 16 kHz; maintains quality practically indistinguishable from the original audio source.

AAC file format specifications allow for greater codec design flexibility than MP3, resulting in more concurrent encoding strategies and efficient compression. The format has been chosen by a number of hardware platforms due to its advantages over MP3 in terms of supporting more options even at lower bitrates.

.flac

A FLAC file is an audio file compressed in the Free Lossless Audio Codec (FLAC) format, which is a lossless audio compression format that is open source. It's similar to an.MP3 file, but it's compressed without affecting productivity or any original audio data. FLAC is the fastest and most widely supported lossless audio codec, as well as the only one that is non-proprietary, patent-free, has an open-source reference implementation, a well-documented format and API, and several other self-sufficient implementation methods.

FRAME: One or more audio frames comprise the audio data.

FRAME HEADER: Contains the stream's general information.

SUBFRAME: Individual subframes within a frame are coded separately to reduce complexity (one frame per channel).

FRAME FOOTER: Contains the complete frame's CRC.

Audio limitation of game platforms

Consoles, handheld consoles, and computers are all examples of game platforms. Modern platforms have few audio limitations in terms of what they can use and play; some will find a way to convert or edit audio files and they'll use the same sound. However, in the past, consoles were severely limited in what they could do.

Because of the available technology at the time, even later consoles could only use simple synthesized sounds that took up a small fraction of a megabyte. This was due to the limited storage capacity of the storage devices used to store the games, such as floppy discs.

Example: Consoles

PlayStation 1 vs PlayStation 5

	PlayStation 1	PlayStation 5
Storage (Capacity & Type)	128KB Memory Cards	825 GB Custom NVMe SSD
Memory	2 MB System RAM 1 MB VRAM	16 GB GDDR6
Network (Wi-fi, Bluetooth, Ethernet)	No	Gigabit Ethernet 6 (802.11ax) 5.1
Storage Expansions	Memory Cards	Can only store PS4 and PlayStation VR games

File format – Audio files are available in a variety of formats, some of which are not supported by certain game engines or platforms. WAV and MP3 are common formats, but each has its own set of limitations. WAV files cannot be larger than 4 GB in size, and MP3 files use lossy compression, which may result in high quality loss.

PlayStation 1	PlayStation 5
.ANM  Animation information for 2D .BGD   Background Map Data .BS      MDEC Stream .CEL    Cell Data .CLT    Palette Data .DA     CD-DA Data .FAT    Memory Card File .HMD  Hierarchical 3D Model plus animation and other data .PMD   High speed Modelling data .PXL    Pixel Image Data	Dolby Digital (max 5.1ch) Dolby Digital Plus (max 7.1ch) Dolby TrueHD (max 7.1ch) DTS (max 5.1ch) AAC (max 5.1ch) DTS-HD High Resolution Audio (max 7.1ch) DTS-HD Master Audio (max 7.1ch) Linear PCM (max 7.1ch) Dolby ATMOS and DTS:X available for Blu-ray and Ultra HD Blu-ray disc video (when connected to a supported device)

Technology – Because of the technology used, different gaming platforms have different limitations. Certain platforms lack the processing power to handle larger, more detailed audio files, such as those with higher sample rates. A game is limited by the RAM capacity of the platform; the game on the disc must work through the RAM, and if the RAM is insufficient, the game will not work (properly). The sound card also limits the sound in games; if the sound card has too few sound chips, it may be unable to process sound at higher sample rates. The quality of the sound heard by the player is also limited by the quality of the speaker used to play the sound, which could be due to the materials used to construct the sections of the speaker.

Game Engine – Different game engines have limitations in terms of which file formats they can support, as well as the size of the file. This may cause issues when attempting to use sound in the creation of game levels, for example.

·       PlayStation 1: PhyreEngine. PhyreEngine is distributed as an installable package that includes both full source code and Microsoft Windows tools. It is distributed under its own flexible use license, which allows any PlayStation 3 game developer, publisher, or tools and middleware company to create software on any platform that is partially or entirely based on PhyreEngine.

·       PlayStation 5: The SSD in every PS5 will be transformative for game development, as the creator of Unreal Engine has witnessed firsthand. Epic Games, the creator of the Unreal Engine, is clearly smitten with the PlayStation 5. The developer chose to debut its next-generation Unreal Engine 5 with a real-time demo on the PlayStation 5.

Not only does the console's advanced CPU and GPU architecture enable significant performance improvements, but Epic was also influenced by Sony's open-source SSD technology. This extends beyond faster loading times. Guaranteeing that level of performance for every PS5 means that developers will be able to stream a large amount of content every second, which could fundamentally change how levels are designed and how constrained they are.

Bits – The PlayStation 1 is lower than the PlayStation 5. So here can be read that it’s a very huge update and change of the bits for both platform.

• PlayStation 1: Sony Computer Entertainment released the PlayStation video game console in 1994. The PlayStation, one of a new generation of 32-bit consoles, signaled Sony's ascension to video game dominance.

• PlayStation 5: 256-bit. The PS5 runs on an AMD CPU chip based on the third generation of AMD's Ryzen line. It's an eight-core, custom-made, beast based on the company's new 7nm Zen 2 microarchitecture. The CPU is a custom variant of AMD Radeon's Navi family and will support ray tracing - an effect that is a staple of Hollywood, and one that's beginning to appear in high-end PC processors and the Nvidia RTX gaming line.

Thanks to the fact the PS5 is switching from disc-based hard drives to SSDs, Sony also changed its approach to how we store games on the next-gen console. You can now configure exactly what parts of a game you want to store on your machine, "allowing a finer-grained access to the data". That means you're able to install just the multiplayer, or just the single-player, or delete one or the other once you're done with it.

Audio recording systems and audio sampling (Equipment)

There are various types of audio equipment that can be used to record, process, and reproduce sound. People can use the right audio equipment to accomplish a variety of tasks as you strive to create exciting and captivating audio.

Microphone

The microphone is, without a doubt, one of the oldest pieces of audio equipment that hasn't changed much over the years. Nonetheless, they are essential pieces of sound equipment that you should always consider purchasing if planning to open a studio and require various types of audio equipment.

The following are the various types of microphones to consider:

Handheld Microphone: Because they pick up on ambient sounds, these microphones are ideal for creating ambience. They are commonly used in live performances, infomercials, news anchors, and talent shows.

Dynamic Microphones: These types of microphones are ideal for recording sounds in a noisy environment. This is why they are a popular choice for artists during live performances.

The best thing about this microphone is that you can closely observe its varying frequencies as well as its versatility, which allows you to use it anywhere. This microphone is placed below or above the actor to pick up the dialog and is not connected to the subject or a camera.

Audio Interface

The first audio interface served two purposes: it transmitted music into your computer while recording and it conveyed signals from your computer during playback. Meanwhile, modern versions have a plethora of additional features, such as monitor management, DI boxes, digital conversion, headphone amps, and mic preamps. As a result, this equipment serves as a bridge between traditional analog audio and digital audio. When performing live instrumentation, an audio interface is essential for converting any acoustic disturbance into a digital file. This enables the conversion of analog instrument recordings, such as the guitar and piano, to digital audio signals.

Headphones

A set of studio monitors will start playing the music making and recording in a large enough space. But that isn't always enough to pay attention to the smallest details. This is where a headphone comes in handy. If users frequently edit and mix by yourself, headphones are an excellent piece of output equipment to have.

Open-Back: Because the space between the headphone and your head is not completely sealed, you can enjoy music in a semi-natural manner. It will be as if you are listening from speakers close to your head. This is an excellent option for tracking (listening to everything).

Closed-Back: This type completely seals the air between the head and the headphone pads. It will improve overall isolation and provide a cleaner sound with no interruptions or external noise. This is the ideal headphone for mixing and editing (listen to small details).

Computers

The first thing needed to get started in computer audio production or recording is, unsurprisingly, a computer. Even low-cost desktop and laptop computers should be capable of handling a recording project from recording to mixing and mastering. However, three factors will determine your system's maximum workload capacity.

The modern music industry is based on digital mastering and processing, and the proliferation of flexible and powerful audio software has enabled a wide range of independent movie, hobbyist, and at-home musicians to advance their audio production workflows.

Digital Audio Desk/Workstation

The Digital Audio Workstation (DAW) is the main piece of software used for recording, creating, and editing audio files. The DAW's original design was intended to resemble the feel and look of an analog mixing board, and its visual appearance hasn't changed much. It is also essential in the creation of electronic music.

There are numerous DAWs on the market to choose from, with the best one being a matter of personal preference, but they all include some common features. Filtering, tempo or pitch modification, and multitrack recording are examples of these characteristics.

Some popular DAWs:

Pro Tools (Mac and PC) – Pro Tools is the “industry standard” digital audio workstation (DAW) for recording, mixing, and mastering. Pro Tools can be found in the majority of professional studios around the world. The ability to manually edit audio wave forms within the track view, rather than exporting them to another program, is one of Pro Tools' more useful features.

Reaper (Mac and PC) – Another good DAW for recording, mixing, and mastering is Reaper. It is one of the few DAWs that can record at incredibly high sample rates, such as the Roland Super UA interface.

Speakers

A studio monitor is a speaker that is intended for use in a professional audio production environment. Studio monitors are used in recording studios, radio and television studios, film production, and other professional sound recording applications. Home studio monitors are also available for use in small or home studios.

The studio monitor's main feature is its ability to produce a flat phase and frequency. The studio monitor generates a very clear audio signal without any misinterpretations. Another thing that the studio monitor must be able to handle is high volume, sudden sound bursts, and a variety of unexpected sounds that can occur during recording or playback of unmastered mixes.