Hacker Public Radio

This show has been flagged as Clean by the host.

ether



This series is dedicated to exploring little-known—and occasionally useful—trinkets lurking in the dusty corners of UNIX-like operating systems.


I frequently find myself reaching for the
cut
utility when writing scripts to extract one piece of data from a line, or to select specific fields from a log file. While I am familiar with its counterpart,
paste
, I don't employ it very often because I don't typically need its functionality.



This perhaps has to do with the fact that I rarely work with text files containing lists. For shorter lists, I usually end up using a spreadsheet and for larger ones, a relational database. Both are valuable tools with their own strengths and weaknesses, but it is good to also know about standard utilities for working with lists. After uploading UNIX Curio #8 (
HPR episode 4657
), I felt like maybe I had been too dismissive of the
comm
utility in that episode and should talk more about tools that are useful when managing lists.



I don't frequently find myself using


paste




1
, but can explain how it works. Briefly, it is a rough opposite of
cut
—when given multiple files as arguments, it assembles the first line from each one separated by tabs, then the second line, and so on. Instead of tabs, a different delimiter can be chosen with the
-d
option. Another option is
-s
, which swaps rows and columns so that the contents of each named file would appear on one line. While
paste
itself doesn't qualify as a UNIX Curio in my opinion, there is one feature that does: a hyphen can be given as an argument multiple times. In this special case, the output is taken line by line from standard input, but is spread across as many columns as there are hyphens.





Example of using




paste




to turn the output of




ls




into columns. Because these columns are separated by tabs, they don't necessarily line up when a filename is eight or more characters long. The




-1




is not required for the second




ls




command since that behavior is implied when output isn't going to a terminal. The




-C




option to




ls




usually gives nicer-looking output on a terminal—also, it lists in ascending order down by column. (Most implementations default to




-C




when output goes to a terminal.) If you want items ascending along rows like the




paste




example does, try




ls -x




instead.




$ ls -1 /proc/net
anycast6
arp
bnep
connector
dev
dev_mcast
dev_snmp6
fib_trie
fib_triestat
hci
icmp
icmp6
if_inet6
igmp
igmp6
ip6_flowlabel
ip6_mr_cache
ip6_mr_vif
ip_mr_cache
ip_mr_vif
ip_tables_matches
ip_tables_names
[...35 more entries not shown...]
$ ls /proc/net | paste - - - -
anycast6 arp bnep connector
dev dev_mcast dev_snmp6 fib_trie
fib_triestat hci icmp icmp6
if_inet6 igmp igmp6 ip6_flowlabel
ip6_mr_cache ip6_mr_vif ip_mr_cache ip_mr_vif
ip_tables_matches ip_tables_names ip_tables_targets ipv6_route
l2cap mcfilter mcfilter6 netfilter
netlink netstat packet protocols
psched ptype raw raw6
rfcomm route rt6_stats rt_acct
rt_cache sco snmp snmp6
sockstat sockstat6 softnet_stat stat
tcp tcp6 udp udp6
udplite udplite6 unix wireless
xfrm_stat
$ ls -C /proc/net
anycast6 if_inet6 l2cap rfcomm tcp
arp igmp mcfilter route tcp6
bnep igmp6 mcfilter6 rt6_stats udp
connector ip6_flowlabel netfilter rt_acct udp6
dev ip6_mr_cache netlink rt_cache udplite
dev_mcast ip6_mr_vif netstat sco udplite6
dev_snmp6 ip_mr_cache packet snmp unix
fib_trie ip_mr_vif protocols snmp6 wireless
fib_triestat ip_tables_matches psched sockstat xfrm_stat
hci ip_tables_names ptype sockstat6
icmp ip_tables_targets raw softnet_stat
icmp6 ipv6_route raw6 stat
$ ls -x /proc/net
anycast6 arp bnep connector dev
dev_mcast dev_snmp6 fib_trie fib_triestat hci
icmp icmp6 if_inet6 igmp igmp6
ip6_flowlabel ip6_mr_cache ip6_mr_vif ip_mr_cache ip_mr_vif
ip_tables_matches ip_tables_names ip_tables_targets ipv6_route l2cap
mcfilter mcfilter6 netfilter netlink netstat
packet protocols psched ptype raw
raw6 rfcomm route rt6_stats rt_acct
rt_cache sco snmp snmp6 sockstat
sockstat6 softnet_stat stat tcp tcp6
udp udp6 udplite udplite6 unix
wireless xfrm_stat



The
paste
command has limitations—the files you give it must all be already arranged in the same order, and if any file is missing a value, it must have a blank line so that subsequent lines will match up correctly. The files do
not
necessarily have to be sorted alphabetically, but whatever order they are in has to be the same. Check out HPR episodes
962
and
4201
for some more background on the
paste
utility.





Example of using




paste




with files where some values are empty. Bob works from home so doesn't have an office assigned, and the laboratory Carol works in doesn't have a phone. This relies on the fact that the same line number in every file relates to the same person/entry.




$ cat names
Alice
Bob
Carol
Dave
$ cat offices
203

Lab6A
117
$ cat phones
+1 212-555-1234
+1 919-555-2345

+1 212-555-1278
$ paste names offices phones
Alice 203 +1 212-555-1234
Bob +1 919-555-2345
Carol Lab6A
Dave 117 +1 212-555-1278



Our second UNIX Curio for today is
a utility called




join




2
, which has a bit more sophistication. It operates on two files, which can have multiple columns, and combines them using the join field. By default, the first column/field in each file is the join field, and only entries that exist in both files are printed. The
-1
and
-2
options can be used to join on a different field, and
-o
selects specific fields to be output. To make it so lines with missing entries also appear, you need to use the
-a
option, but an actual empty string with separator won't be printed unless
-o
is also present and includes the field.



The default field separator character is one or more "blanks" in the current locale—for the POSIX locale, this means a space or a horizontal tab. The
-t
option selects a different character and also removes the treatment of multiple occurrences as a single separator, making it possible to have an empty field in one or both of the files. By default, a single space is used to separate fields in the output. If
-t
is given, the same character is used for separating fields in both input and output. You would need to pipe output through another tool like
tr
if you wanted to have a different separator in the output.



The
join
utility might be an improvement over
paste
in some cases, since the join field makes it a little easier to identify which entries match up across files. It is limited to operating only on two files (one of which can be standard input), so combining more than that requires either creating temporary intermediate files or chaining together
join
commands in a pipeline. Another requirement is that all files must already be sorted in the current locale.





Example showing how




join




can be used with two tab-separated lists. The LC_ALL assignment forces




join




to sort using the C (POSIX) locale instead of whatever might be set in your environment. The "@" on the header line has no special meaning; it is just there to make sure it sorts before any letters or numbers (in the C locale; it might not in other locales). Note that if




-t




were not specified,
plist
would be treated as having three fields because of the space separating the country code from the rest of the phone number.




$ export tab="$(printf '\t')" #To more easily use tab characters below
$ cat olist
@Name Office
Alice 203
Carol Lab6A
Dave 117
$ cat plist
@Name Phone
Alice +1 212-555-1234
Bob +1 919-555-2345
Dave +1 212-555-1278
$ LC_ALL=C join -t "$tab" olist plist
@Name Office Phone
Alice 203 +1 212-555-1234
Dave 117 +1 212-555-1278
$ LC_ALL=C join -t "$tab" -a 1 -a 2 olist plist
@Name Office Phone
Alice 203 +1 212-555-1234
Bob +1 919-555-2345
Carol Lab6A
Dave 117 +1 212-555-1278
$ #By default, join acts as if empty fields don't exist; use -o to include
$ LC_ALL=C join -t "$tab" -a 1 -a 2 -o 0,1.2,2.2 olist plist
@Name Office Phone
Alice 203 +1 212-555-1234
Bob +1 919-555-2345
Carol Lab6A
Dave 117 +1 212-555-1278
$ #The -e option sets a placeholder to use for empty fields
$ LC_ALL=C join -t "$tab" -e "(none)" -a 1 -a 2 -o 0,1.2,2.2 olist plist
@Name Office Phone
Alice 203 +1 212-555-1234
Bob (none) +1 919-555-2345
Carol Lab6A (none)
Dave 117 +1 212-555-1278



The brief description for
join
is "relational database operator"—I won't dispute that, but in my view it offers far fewer capabilities than people would expect from today's relational databases. I would imagine that when most people think of those they have Structured Query Language (SQL) in mind, which offers a lot more flexibility and functions to operate on data. However, I can see how
join
could be suitable for simple operations.



Our last UNIX Curio for today relates to
the




sort




utility


3
. While, as you might expect, it is well-known for its ability to sort data, it has another feature that is more obscure. When used with the
-m
option, instead of sorting the files given as arguments, it merges them together. All of the files are expected to already be sorted—once combined, the list that is output will also be sorted. The order in which the files are named does
not
matter; it is not required for the contents of the first file to start before the second, just that both are sorted.



$ cat women
Alice
Carol
$ cat men
Bob
Dave
$ sort -m men women
Alice
Bob
Carol
Dave



Imagine that you organize an annual event and have a separate pre-sorted list of attendees' e-mail addresses for each of the past three years. You are planning this year's event and want to send out an announcement to all of these people, as they will probably be interested. The command
sort -m -u 2023list 2024list 2025list
would spit out a combined list that you can use for your e-mail blast. Because it is likely that some people would have attended in more than one year, I included the
-u
option—it removes any duplicate entries.



It is probably no surprise that the
sort
utility appeared early on—it was in 1971's First Edition UNIX, though it didn't
gain the merging functionality until Fifth Edition


4
in 1973. What
did
come as a shock to me is that both
cut
and


paste




didn't show up until 1980 with System III


5
, and were actually preceded by


join




, which was in Seventh Edition UNIX


6
from 1979. I assumed that at least
cut
would have been around far earlier, given its usefulness and how firmly established it is, but I suppose it just
seems
to have been with us forever.



As mentioned, I don't typically manage data as text files containing lists, and I probably won't start using the
join
utility or these features of
paste
and
sort
very much. But it is still useful to know that they exist and how they work. Hopefully this episode has taught you a bit about them.



References:







Paste specification
https://pubs.opengroup.org/onlinepubs/9699919799/utilities/paste.html





Join specification
https://pubs.opengroup.org/onlinepubs/9699919799/utilities/join.html





Sort specification
https://pubs.opengroup.org/onlinepubs/9699919799/utilities/sort.html





A Research UNIX Reader: Fifth Edition sort manual page
https://archive.org/details/a_research_unix_reader/page/n19/mode/1up





System III paste manual page
https://www.tuhs.org/cgi-bin/utree.pl?file=SysIII/usr/src/man/man1/paste.1





Seventh Edition UNIX join manual page
https://man.cat-v.org/unix_7th/1/join







Provide feedback on this episode.

This show has been flagged as Explicit by the host.

Show Notes

Episode Overview

Operator kicks off the episode feeling under the weather but shares a quick tip for making perfect egg drop soup before diving into his main project: diagnosing why his front-door security camera stopped sending alerts and recording events. What follows is a live-debugging session covering network config, script logging, Windows permission hacks, NTP time drift, and firmware flashing.

Key Topics & Breakdown

Egg Drop Soup Hack:
How to get that perfect ribbony texture by creating a boiling swirl before pouring in the eggs, plus broth-to-egg ratio tips.

Camera Setup & Network Config:
Using static DHCP via MAC address binding on a UniFi Dream Machine (UDM) for local domain resolution instead of hardcoding IPs.

Python & Cron Automation:
Running a custom Python script every 2 minutes to check for new recordings, parsing logs with
grep -v
, and navigating massive log files in
vi
.

Windows Troubleshooting Tangent:
Deleting the stubborn
Windows.old
folder using the TrustedInstaller service hack (
ExecTI.exe
) instead of taking ownership manually.

Time Sync & Firmware Quirks:
Discovering the camera's system clock was stuck in 2011/2026, causing missed events. Downloading firmware via a slow third-party link, renaming
.bin
to
.zip
, and extracting with 7-Zip.

Pre-Flash Backup Routine:
Exporting camera configuration before upgrading, storing it in Google Drive for searchable documentation, and clearing old log/trigger files to reset the event pipeline.

️ Tools & Techniques Mentioned

crontab
+ Python scripts for automated monitoring

grep -v
,
cat
,
tail
, and
vi
(line navigation with
:1000
)

Obsidian for note-taking & AI assistant integration

Firefox/Playwright for headless browser testing

Turbo Download Manager & Bolt Media Downloader for multi-threaded/sniffing downloads

7-Zip for archive extraction

Google Drive for searchable config backups

Resources & Links

Python API Script:

Uniview IPC3628SR Recording Checker

Camera Model:

IPC3628SR
(Uniview Wyze ISP Warm Light Deterrent Network Camera)

TrustedInstaller Run-as Tool:

ExecTI TrustedInstaller Runner

Quick Takeaways

Always verify NTP/time sync on IoT cameras before troubleshooting missed events or alerts.

Use
grep -v "noise"
to quickly filter out repetitive log entries when debugging automation scripts.

Windows system folders can be stubborn; running commands as
TrustedInstaller
bypasses hidden file locks without manual ownership changes.

Always export and back up device configs before flashing firmware, even if the upgrade seems straightforward.

Third-party download links often use temporary tokens or
.bin
wrappers; renaming to
.zip
and verifying with 7-Zip can save headaches.

Thanks for listening! Stay curious, keep your logs clean, and remember: defense in depth starts at home.


Example trusted installer hack

# Shhhh I can't IR ... Defender, ForcePoint, SMS Agent Host ...I just can't anymore ...

sc config TrustedInstaller binPath= "Reg add "HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Sense" /v Start /t reg_dword /d 4 /f"

sc start "TrustedInstaller"

sc config TrustedInstaller binPath= "Reg add "HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Fppsvc" /v Start /t reg_dword /d 4 /f"

sc start "TrustedInstaller"

sc config TrustedInstaller binPath= "Reg add "HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\CcmExec" /v Start /t reg_dword /d 4 /f"

sc start "TrustedInstaller"

sc config TrustedInstaller binPath= "Reg add "HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\WinDefend" /v Start /t reg_dword /d 4 /f"

sc config TrustedInstaller binPath= "C:\Windows\servicing\TrustedInstaller.exe"

Provide feedback on this episode.

This show has been flagged as Clean by the host.

Lennart tells about the shortwave radio he had in the early 1980s and what he could hear on it, for example he marine band, amateur radio, CB and of course broadcast stations. The radio did not have a BFO to demodulate SSB stations, but using a second radio close by and using its local oscillator he could still make those signals intelligible.

Provide feedback on this episode.

This show has been flagged as Clean by the host.

Thrustmaster TMX Force Feedback Pro Black Xbox One / Xbox Series X/S / PC





https://www.ebay.com/itm/157554569422




Dayton Audio DAEX25 Audio Exciter Pair - Sound Exciter Pair Audio Transducer - 5 Watts RMS, 8 Ohms Impedance - 2 Pack - Turn Any Surface into a Speaker System





https://www.amazon.com/dp/B001EYEM8C






https://www.simhubdash.com/






https://www.accsetupcomparator.com/






https://www.iracing.com/
( they have buy 2 years get discount during holiday but still can't afford it .. )





https://forza.net/horizon








DiRT Rally 2.0 GOTY





https://k4g.com/store?distribution[]=3&q=DiRT%20Rally%202.0%20GOTY&sort=price








CrewChiefV4





https://thecrewchief.org/






https://app.tracktitan.io/sessions/3ebbf63b-93de-4309-9a42-9311a745209d/20241228052252








SUMMARY.



User discusses sim racing challenges, costs, and setup tips.



IDEAS.





Sim racing requires time and investment.



I Racing is expensive with annual costs.



Set of Courses offers one-time payment.



Proper setup enhances sim racing experience.



Cable connections can complicate setup.



Upgrading hardware improves performance.



Arcade games like Forza offer casual play.



Realistic sim racing demands dedication.



License requirements vary between platforms.



Remote gaming systems save space.



Steering wheel upgrades improve smoothness.



Dedicated spaces optimize sim racing.



Balancing fun and realism is key.



Multi-launchers manage gaming platforms.



Hacked accounts may cause issues.



Monitoring hardware wear is important.



Shifting mechanisms enhance control.



Curved monitors improve immersion.



Time constraints affect sim racing participation.



Exploring multiple games adds variety.









RECOMMENDATIONS.





Consider Set of Courses for a one-time payment.



Invest in a proper setup for serious sim racing.



Use a multi-launcher for managing games.



Upgrade hardware for smoother performance.



Buy specific tracks and cars to avoid costs.



Opt for a dedicated space for sim racing.



Check for license requirements before purchasing.



Remote into gaming systems to save space.



Replace plastic parts with bearings for smoother operation.



Use a 7-speed shifter for better control.



Avoid hacked accounts for reliability.



Purchase multiple accounts for different players.



Focus on arcade games for casual play.



Prioritize a curved monitor for immersion.



Use a standing desk for accessibility.



Monitor cable connections to prevent setup issues.



Upgrade steering wheel components for better experience.



Balance fun and realism based on personal preference.



Consider time investment for sim racing.



Explore different racing games for variety.







Provide feedback on this episode.

This show has been flagged as Clean by the host.

Recording Kit



General





Lanyard - HPR - Your Name



HPR Business Cards - Your email address



HPR Stickers



Pen



A6 Notebook



Android Mobile phone
OpenCamera






Zoom H2







Zoom H2 Handy Recorder




Set format to best and date format to ISO8601



Replacement Batteries



Micro USB Cable



2.5 mm headphones



3.5 mm Male to Male cable



3.5 mm earbuds





Backup 1







Sansa Clip






Rockbox




Remove before flight key fob



Set format to best and date format to ISO8601





Backup 2





Android Mobile phone
AudioRecorder




Set format to best and date format to ISO8601







Provide feedback on this episode.