The browser's network panel made the size of the problem obvious. The truncated response came back at about 471 KB. The same page on production was about 1.13 MB.

The tell: it only happens to big responses

If small responses are fine and large ones get cut off, think about buffering before you think about application code.

With proxy_buffering on (the default), NGINX reads the upstream response into memory buffers (proxy_buffers, proxy_buffer_size). When a response is bigger than those buffers can hold, NGINX spools the overflow to a temporary file under proxy_temp_path and streams it to the client from there.

If NGINX can't open that temporary file, it can't hold the rest of the response. The client has already received the headers and part of the body, so you get a truncated page with a 200 status instead of an error.

The one line that explained it

The answer was in NGINX's error log:

[crit] ... open() "/usr/local/openresty/nginx/proxy_temp/..." failed (13: Permission denied) while reading upstream

NGINX tried to create a temp file and the kernel refused.

Why the permissions were wrong

On that box, the NGINX user directive had been changed at some point. The workers there ran as lucee, while production ran them as nobody. The hashed subdirectories inside proxy_temp were created back when the workers still ran as nobody, and they were still 0700 nobody:nobody.

That's an easy one to miss. At startup NGINX makes sure the top-level temp directories belong to the worker user, but it doesn't walk the hashed subdirectories (levels=1:2) already inside them. So the top-level directory looks correct, and the subdirectories one level down are locked to the old user.

# What user are the workers running as?
ps -o user=,cmd= -C nginx | grep worker

# Who owns the temp tree, all the way down?
find /usr/local/openresty/nginx/proxy_temp -maxdepth 2 -printf '%u:%g %m %p\n' | head

The fix

Give the temp trees to the worker user and reload:

WORKER_USER=lucee
for d in proxy_temp client_body_temp fastcgi_temp uwsgi_temp scgi_temp; do
  [ -d "/usr/local/openresty/nginx/$d" ] && chown -R "$WORKER_USER:" "/usr/local/openresty/nginx/$d"
done
openresty -t && systemctl reload openresty

proxy_temp was the one that bit here. The others fail the same way, though. client_body_temp breaks large uploads, and fastcgi_temp breaks large PHP responses, so fix them all at once.

Adjust the paths for a stock NGINX package (usually /var/cache/nginx/...). If SELinux is enforcing and NGINX runs confined, also check the directories' labels with ls -Z.

Keeping it from coming back

• Treat the user directive and the temp-directory ownership as one change. If your config management sets user, have the same role set ownership on the temp paths.
• Diff environments, not just files. Staging and production had the same templates but a different worker user, and that drift is the whole bug. Worth a check across the fleet:

  ansible web -m shell -a "ps -o user= -C nginx | sort | uniq -c"
  

• Alert on [crit] in the NGINX error log. This one wrote a clear message on every truncated request, and nobody was watching for it.

The short version

If NGINX returns 200 but large pages are cut off, search the error log for Permission denied on a *_temp path. Then compare the worker user to the owner of the hashed subdirectories, not just the top-level directory.

@echo off
REM Add Sublime Text to Windows 11 Right-Click Context Menu
REM Run this batch file as Administrator

echo Adding Sublime Text to context menu...
echo.

REM Check if Sublime Text exists at the specified path
if not exist "C:\Program Files\Sublime Text\sublime_text.exe" (
    echo ERROR: Sublime Text not found at "C:\Program Files\Sublime Text\sublime_text.exe"
    echo Please verify the installation path.
    echo.
    pause
    exit /b 1
)

REM Add context menu for folders
reg add "HKEY_CLASSES_ROOT\Directory\shell\OpenWithSublime" /ve /t REG_SZ /d "Open with Sublime Text" /f
reg add "HKEY_CLASSES_ROOT\Directory\shell\OpenWithSublime" /v "Icon" /t REG_SZ /d "C:\\Program Files\\Sublime Text\\sublime_text.exe,0" /f
reg add "HKEY_CLASSES_ROOT\Directory\shell\OpenWithSublime\command" /ve /t REG_SZ /d "\"C:\\Program Files\\Sublime Text\\sublime_text.exe\" \"%%1\"" /f

REM Add context menu for folder background (right-click inside folder)
reg add "HKEY_CLASSES_ROOT\Directory\Background\shell\OpenWithSublime" /ve /t REG_SZ /d "Open with Sublime Text" /f
reg add "HKEY_CLASSES_ROOT\Directory\Background\shell\OpenWithSublime" /v "Icon" /t REG_SZ /d "C:\\Program Files\\Sublime Text\\sublime_text.exe,0" /f
reg add "HKEY_CLASSES_ROOT\Directory\Background\shell\OpenWithSublime\command" /ve /t REG_SZ /d "\"C:\\Program Files\\Sublime Text\\sublime_text.exe\" \"%%V\"" /f

echo.
echo Sublime Text has been added to the context menu!
echo You can now right-click on folders to open them in Sublime Text.
echo.
pause

Today I wanted to search and replace text in a JSON file using VIM.

Turns out it is rather easy.

:%s/"login"/"username"/g

In my situation I needed to include the quotes too and it handled it just fine. Go VIM.

git init .

I then went to GitHub and created the project there. I chose a license file since this was a public repository.

That created the initial commit, adding the license file.

So, when I added the remote to my local repository, I had 2 separate main branches.

Turns out I lucked out this time because I was at the very beginning of my project.

The following command saved the day:

pull origin main --allow-unrelated-histories

I am not sure of the drawbacks of doing this, but at this stage of the project, I am not too worried about it.

It has been a while since Digital Ocean droplets are inexpensive to fire up and use.

Here are the commands I used today to get everything going.

# Make sure your system is up to date
sudo apt update
sudo apt upgrade

# Install packages to get the party started
sudo apt install build-essential dkms linux-headers-$(uname -r)

# At this point I rebooted.  Not sure if it was necessary.
sudo reboot

# Here is where I inserted the Guest Edition ISO from
# Devices -> Insert Guest Additions CD Image...

# I did not have a mount point set so nothing was working.
sudo mkdir /media/cdrom

# Mount the CD
sudo mount /dev/cdrom /media/cdrom

# Run the install
cd /media/cdrom
sudo ./VBoxLinuxAdditions.run

# Reboot for everything to take hold.
sudo reboot

Guest Editions ISO Screenshot

I had a situation where I wanted to check if some SQL changes I made were working properly.

It involved a transaction with a bunch of queries. Yes I could verify the data but I wanted to visually see the queries that my scripts were generating.

Turning on the general query log was not an option for me because of the amount of queries that get run every second.

During my DB research I found MySQL’s performance schema.

This query here will show you the last 10 statements that were ran for a particular table in a particular database.

I did see that if you do not prefix your tables with the db name in your query you’ll have to remove the line that looks for the db table.

SELECT event_id, event_name, sql_text, timer_wait FROM performance_schema.events_statements_history_long WHERE sql_text LIKE '%TABLE_NAME%' AND sql_text LIKE '%DATABASE_NAME%' ORDER BY timer_start DESC LIMIT 10;

MySQL’s performance schema tables look awesome. I feel like there is a lot of untapped awesomness there that I need to research to help me as a programmer as well as helping me when I wear by DBA hat.

Here is how to to see the size in MB

Here is how to see the size in GB

I recently had a couple separate tasks running on the same database and I wanted to make sure that the second task did not interefere with the other task.

To help with this I made sure that the second task waited for 5 minutes before grabbing the data.

Here is how you do that in MySQL

SELECT * FROM your_table_name WHERE datecreated <= NOW() - INTERVAL 5 MINUTE;

Boy I wish there was a way to create a table from a select query

I started in Navicat to see if it was possible.  After find nothing I decided to google it all the while thinking in my head how I was going to create a script to do this if I couldn't find anything.

I found something. I was happy yet sad.  Happy because I didn't have to take the time to create something.  Sad because I didn't have to create the tool.  It sounded like a fun project.

What did I find you ask? 

The "Create Table as" statement.

CREATE TABLE [ IF NOT EXISTS ] new_table [ AS ] SELECT expressions FROM existing_tables [WHERE conditions];

The best part about it is the statement knows to go to the existing tables to get the column type, size etc.   Such a tremendous time saver.  I cannot believe in all my years of programming I never stumbled upon this type of statement.

Source: Tech on the Net

The server time zone value 'EDT' is unrecognized or represents more than one time zone. You must configure either the server or JDBC driver (via the serverTimezone configuration property) to use a more specifc time zone value if you want to utilize time zone support.

I was able to get around this by adding a custom jdbc option to my datasource:

cfconfig datasource save name=test dbdriver=mysql host=localhost port=3306 database=testdb username=randy password=test custom="serverTimezone=America/New_York"

Today I decided to research and see what other GUI clients I could find for GIT.

I stumbled upon SourceTree  by Atlassian Software.

It was really easy to setup a local repository as well as connecting to GitHub.

My favorite feature so far besides the ease of use is the dashboard that shows you the files that need committed and the diff details right beside it.

Here is a screenshot:

http://www.w3schools.com/jsref/jsref_parseint.asp

Javascript For Loop

http://www.w3schools.com/js/js_loop_for.asp

User Id and Shipper Number combination is not qualified to receive negotiated rates.

and to make matters worse, the result of this issue caused the checkout process to error preventing our customers from finishing their orders.

So after doing a little research on my end I ended up calling the UPS technical support phone number for the United States:

Over the phone we went over the following steps:

UPS.COM You must add and authenticate your account using Account Summary to view Negotiated Rates in UPS Internet Shipping, Time and Cost Calculator on ups.com, and the UPS Developer Kit - Shipping and Rating APIs.

To add and authenticate an account:

1. Login to ups.com using your My UPS ID and password. 2. Select the My UPS tab at the top of the page. 3. Select Account Summary from the navigation menu or the tab rollover. 4. From there select Add an Existing UPS Account. 5. Follow the steps to authenticate the account. To authenticate your account you will need the following information from your most recent UPS invoice: invoice date, amount due, invoice number, and control number.

Normally this should work but for us it did not because we already did those steps. My case was escalated and I am waiting for a call back.

I disabled UPS on the website so our customers could still place an order.  Now I can breath a little easier.

I will update this post with the resolution as it becomes available.

*UPDATE at 1:57pm* UPS called me back and told me there is a global outage for negotiated rates.  They estimate a minimum of 2 hours to restore access.

I chose to just stop and restart Jetty because I was on a dev box.  The instructions seem to be straight forward.

My question is though.  If I disable the memory mapped files will there a performance degradation?

select version();

Reference: PostgreSQL Wiki

Here is the link:

Railo Admin Password Reset

This command does the trick.

yum list installed | grep "postgres"

The websites are hosted on the Rackspace Cloud and use Sendgrid.

Here is the SPF record to use:

v=spf1 include:_spf.google.com include:sendgrid.net ~all

This is a quick note to remind you about the command to test your apache config file before actually restarting apache:

You can check your configuration files for syntax errors without starting the server by using apachectl configtest or the -t command line option.

Source: Apache Docs

This rule appends the rule.  This particular rule  opens inbound port 5432 to the ipaddress 111.222.33.44**

iptables -A RH-Firewall-1-INPUT -p tcp -s 111.222.33.44 --dport 5432 -j ACCEPT

This rule inserts the rule at the start of the chain.  

iptables -I RH-Firewall-INPUT -s 111.222.33.44 -p tcp -m tcp --dport 5432 -j ACCEPT

** After adding rules you need to issue this command to save the rules.**

service iptables save

After saving you need to issue the restart command

service iptables restart

If you want to see the available chains in your firewall use this command:

iptables -L

Turns out this is easy in Coldfusion 9:

WriteDump (var, output, format, abort, label, metainfo, top, show, hide, keys, expand, showUDFs);

My Example:

WriteDump (var=results,output=true,format="html",abort=true);

Adobe Help

To vacuum one database from the command line.

vacuumdb -d MyDB -v  -z -U postgres

To vacuum one database from the command line.

vacuumdb -a -v  -z -U postgres

-d = database name -v = verbose output -z = analyze -U = username -a = vacuum all databases

Here is the command I used:

CREATE DATABASE MyDB ENCODING 'SQL_ASCII' TEMPLATE template0;

I had to use template0 because template1 was set to UTF8.

I still need to dig in on the templates and what they are all about.

To find packages:

rpm -qa | grep -i webmin

To unistall the package:

rpm -e

If you need to uninstall more than one package at a time

rpm -e

It is as simple as this:

fg

Read the post for other options, but the above is what I needed.  Worked like a charm

An Almost Idiots Guide To Install PostgreSQL 9.0 With YUM

1.  Command line usage:

• su - postgres
• psql
• select version();

2.  Dumping data for import on another server

• pg_dump -o mydb -U postgres -W > mydb.sql

• -o has to do with oids (Not sure if I need this yet)

• -U is for user

• -W is for password.  It prompts when you run the command