Fail to login to wordpress

[dofrance]

Hi,
Thank you for your great Varnish4 config, my frontend page run really fast but when I try to login to Wordpress at login page, it fail with this

Error 503 Backend fetch failed
Backend fetch failed
Guru Meditation:
XID: 32788
Varnish cache server

I use Nginx as backend server on port 8080 for HTTP request. Here is my Varnish log:
<< BeReq >> 32858

• Begin bereq 32857 pass
• Timestamp Start: 1440994979.525020 0.000000 0.000000
• BereqMethod POST
• BereqURL /wp-login.php
• BereqProtocol HTTP/1.1
• BereqHeader Host: exciter.com
• BereqHeader Content-Length: 114
• BereqHeader Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,/;q=0.8
• BereqHeader Origin: http://exciter.com
• BereqHeader User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36
• BereqHeader Content-Type: application/x-www-form-urlencoded
• BereqHeader Referer: http://exciter.com/wp-login.php?redirect_to=http%3A%2F%2Fexciter.com%2Fwp-admin%2F&reauth=1
• BereqHeader Accept-Encoding: gzip, deflate
• BereqHeader Accept-Language: en-US,en;q=0.8,vi;q=0.6
• BereqHeader Cookie: PHPSESSID=rljmukr2iji6som9mcgsv9t1k7; _ga=GA1.2.1653772168.1440994312; woocommerce_cart_hash=null; wfvt_662187887=55e3d69164314; wordpress_test_cookie=WP+Cookie+check
• BereqHeader Cache-Control: max-age=0
• BereqHeader X-Forwarded-For: 222.222.217.191, 222.222.217.191
• BereqHeader X-Varnish: 32858
• VCL_call BACKEND_FETCH
• VCL_return fetch
• FetchError no backend connection
• Timestamp Beresp: 1440994979.525360 0.000340 0.000340
• Timestamp Error: 1440994979.525375 0.000355 0.000015
• BerespProtocol HTTP/1.1
• BerespStatus 503
• BerespReason Service Unavailable
• BerespReason Backend fetch failed
• BerespHeader Date: Mon, 31 Aug 2015 04:22:59 GMT
• BerespHeader Server: Varnish
• VCL_call BACKEND_ERROR
• BerespHeader Content-Type: text/html; charset=utf-8
• BerespHeader Retry-After: 5
• VCL_return deliver
• Storage malloc Transient
• ObjProtocol HTTP/1.1
• ObjStatus 503
• ObjReason Backend fetch failed
• ObjHeader Date: Mon, 31 Aug 2015 04:22:59 GMT
• ObjHeader Server: Varnish
• ObjHeader Content-Type: text/html; charset=utf-8
• ObjHeader Retry-After: 5
• Length 282
• BereqAcct 0 0 0 0 0 0
• End

<< Request >> 32857

• Begin req 32856 rxreq
• Timestamp Start: 1440994979.524812 0.000000 0.000000
• Timestamp Req: 1440994979.524812 0.000000 0.000000
• ReqStart 222.222.217.191 53004
• ReqMethod POST
• ReqURL /wp-login.php
• ReqProtocol HTTP/1.1
• ReqHeader Host: exciter.com
• ReqHeader Content-Length: 114
• ReqHeader Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,/;q=0.8
• ReqHeader Origin: http://exciter.com
• ReqHeader User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36
• ReqHeader Content-Type: application/x-www-form-urlencoded
• ReqHeader Referer: http://exciter.com/wp-login.php?redirect_to=http%3A%2F%2Fexciter.com%2Fwp-admin%2F&reauth=1
• ReqHeader Accept-Encoding: gzip, deflate
• ReqHeader Accept-Language: en-US,en;q=0.8,vi;q=0.6
• ReqHeader Cookie: PHPSESSID=rljmukr2iji6som9mcgsv9t1k7; _ga=GA1.2.1653772168.1440994312; woocommerce_cart_hash=null; wfvt_662187887=55e3d69164314; wordpress_test_cookie=WP+Cookie+check
• ReqHeader Cache-Control: max-age=0
• ReqHeader Connection: keep-alive
• ReqHeader X-Forwarded-For: 222.222.217.191
• VCL_call RECV
• ReqUnset X-Forwarded-For: 222.222.217.191
• ReqHeader X-Forwarded-For: 222.222.217.191, 222.222.217.191
• VCL_return pass
• VCL_call HASH
• VCL_return lookup
• VCL_call PASS
• VCL_return fetch
• Link bereq 32858 pass
• Timestamp Fetch: 1440994979.525510 0.000697 0.000697
• Timestamp ReqBody: 1440994979.525573 0.000761 0.000064
• RespProtocol HTTP/1.1
• RespStatus 503
• RespReason Backend fetch failed
• RespHeader Date: Mon, 31 Aug 2015 04:22:59 GMT
• RespHeader Server: Varnish
• RespHeader Content-Type: text/html; charset=utf-8
• RespHeader Retry-After: 5
• RespHeader X-Varnish: 32857
• RespHeader Age: 0
• RespHeader Via: 1.1 varnish-v4
• VCL_call DELIVER
• RespUnset Server: Varnish
• RespUnset X-Varnish: 32857
• RespUnset Via: 1.1 varnish-v4
• RespHeader X-Cache: MISS
• VCL_return deliver
• Timestamp Process: 1440994979.525592 0.000780 0.000019
• RespHeader Content-Length: 282
• Debug "RES_MODE 2"
• RespHeader Connection: keep-alive
• Timestamp Resp: 1440994979.525638 0.000825 0.000046
• Debug "XXX REF 1"
• ReqAcct 752 114 866 198 282 480
• End

[Oyabi]

Hi,
can you post your varnish configuration please ?
Have you these lines ?

[...]
    # Did not cache the admin and login pages
    if (req.url ~ "/wp-(login|admin)") {
        return (pass);
    }
[...]
    # Only allow cookies to be set if we're in admin area
    if (beresp.http.Set-Cookie && bereq.url !~ "^/wp-(login|admin)") {
            unset beresp.http.Set-Cookie;
        }
[...]

Regards.

[dofrance]

Hi Oyabi,
I did have those lines because I copy entire of your conf from
https://github.com/nicolargo/varnish-nginx-wordpress/blob/master/varnish/varnish4-wordpress

[Oyabi]

Have you made any change to the config ?
Can you post your config please ?
What's your varnish version ? (varnishd -V)
When you curl/wget 127.0.0.1:8080, can you confirm that you get your site ?
Restart nginx, then restart varnish, and retest.
What's your OS ? I read that SElinux can cause problem.

Regards.

[dofrance]

My OS is Ubuntu server 14.04
varnishd -V
varnishd (varnish-4.0.3 revision b8c4a34)
Copyright (c) 2006 Verdens Gang AS
Copyright (c) 2006-2014 Varnish Software AS

Here's my varnish config

vcl 4.0;

# Default backend definition. Set this to point to your content server.
backend default {
    .host = "127.0.0.1";
    .port = "8888";
}

backend exciter {
        .host = "127.0.0.1";
        .port = "8080";
     .connect_timeout = 30s;
     .between_bytes_timeout = 15s;
     .first_byte_timeout = 300s;
}

acl purge {
    "localhost";
    "127.0.0.1";
}

import std;
include "inc/xforward.vcl";
include "inc/bigfiles.vcl";
include "inc/purge.vcl";

sub vcl_recv {

    # Normalize the header, remove the port (in case you're testing this on various TCP ports)
   set req.http.Host = regsub(req.http.Host, ":[0-9]+", "");

    # Allow purging from ACL
    if (req.method == "PURGE") {
        # If not allowed then a error 405 is returned
        if (!client.ip ~ purge) {
            return(synth(405, "This IP is not allowed to send PURGE requests."));
        }   
        # If allowed, do a cache_lookup -> vlc_hit() or vlc_miss()
        return (purge);
    }

    # Post requests will not be cached
    if (req.http.Authorization || req.method == "POST") {
        return (pass);
    }

# ---------------------- /BACKEND Routing-------------------- #

    if (req.http.host == "exciter.com") {
       set req.backend_hint = exciter;
    }

# ---------------------- /BACKEND Routing-------------------- #

# ---------------------- /WORDPRESS SPECIFIC CONFIG -------------------- #
    # Did not cache the RSS feed
    if (req.url ~ "/feed") {
        return (pass);
    }

    # Blitz hack
        if (req.url ~ "/mu-.*") {
                return (pass);
        }

    # Did not cache the admin and login pages
    if (req.url ~ "/wp-(login|admin)") {
        return (pass);
    }

    if (req.http.Cookie ~ "wordpress_logged_in_") {
        return (pass); # varnish 4
    }   

    if (req.http.X-Requested-With == "XMLHttpRequest") {
      return (pass);
    } 
     # Do not cache the WooCommerce pages
     ### REMOVE IT IF YOU DO NOT USE WOOCOMMERCE ###
    if (req.url ~ "/(cart|my-account|checkout|addons|/?add-to-cart=)") {
            return (pass);
        }

    # Remove the "has_js" cookie
    set req.http.Cookie = regsuball(req.http.Cookie, "has_js=[^;]+(; )?", "");

    # Remove any Google Analytics based cookies
    set req.http.Cookie = regsuball(req.http.Cookie, "__utm.=[^;]+(; )?", "");

    # Remove the Quant Capital cookies (added by some plugin, all __qca)
    set req.http.Cookie = regsuball(req.http.Cookie, "__qc.=[^;]+(; )?", "");

    # Remove the wp-settings-1 cookie
    set req.http.Cookie = regsuball(req.http.Cookie, "wp-settings-1=[^;]+(; )?", "");

    # Remove the wp-settings-time-1 cookie
    set req.http.Cookie = regsuball(req.http.Cookie, "wp-settings-time-1=[^;]+(; )?", "");

    # Remove the wp test cookie
    set req.http.Cookie = regsuball(req.http.Cookie, "wordpress_test_cookie=[^;]+(; )?", "");

    # Are there cookies left with only spaces or that are empty?
    if (req.http.cookie ~ "^ *$") {
            unset req.http.cookie;
    }

    # Cache the following files extensions 
    if (req.url ~ "\.(css|js|png|gif|jp(e)?g|JP(E)?G|swf|ico)") {
        unset req.http.cookie;
    }

    # Normalize Accept-Encoding header and compression
    # https://www.varnish-cache.org/docs/3.0/tutorial/vary.html
    if (req.http.Accept-Encoding) {
        # Do no compress compressed files...
        if (req.url ~ "\.(jpg|png|gif|gz|tgz|bz2|tbz|mp3|ogg)$") {
                unset req.http.Accept-Encoding;
        } elsif (req.http.Accept-Encoding ~ "gzip") {
                set req.http.Accept-Encoding = "gzip";
        } elsif (req.http.Accept-Encoding ~ "deflate") {
                set req.http.Accept-Encoding = "deflate";
        } else {
            unset req.http.Accept-Encoding;
        }
    }

    # --- End of Wordpress specific configuration

    # Did not cache HTTP authentication and HTTP Cookie
    if (req.http.Authorization || req.http.Cookie) {
        # Not cacheable by default
        return (pass);
    }
    # Cache all others requests
    return (hash);
}

sub vcl_pipe {
    # Force every pipe request to be the first one.
    # https://www.varnish-cache.org/trac/wiki/VCLExamplePipe
    return (pipe);
}

sub vcl_pass {
    return (fetch);
}

sub vcl_hash {
    hash_data(req.url);
    if (req.http.host) {
        hash_data(req.http.host);
    } else {
        hash_data(server.ip);
    }
    # If the client supports compression, keep that in a different cache
        if (req.http.Accept-Encoding) {
            hash_data(req.http.Accept-Encoding);
    }     
    return (lookup);
}

sub vcl_backend_response {
# Remove some headers we never want to see
    unset beresp.http.Server;
    unset beresp.http.X-Powered-By;

    # For static content strip all backend cookies
    if (bereq.url ~ "\.(css|js|png|gif|jp(e?)g)|swf|ico") {
        unset beresp.http.cookie;
    }

    # Only allow cookies to be set if we're in admin area
    if (beresp.http.Set-Cookie && bereq.url !~ "^/wp-(login|admin)") {
            unset beresp.http.Set-Cookie;
        }

    # don't cache response to posted requests or those with basic auth
    if ( bereq.method == "POST" || bereq.http.Authorization ) {
            set beresp.uncacheable = true;
        set beresp.ttl = 120s;
        return (deliver);
        }

        # don't cache search results
    if ( bereq.url ~ "\?s=" ){
        set beresp.uncacheable = true;
                set beresp.ttl = 120s;
                return (deliver);
    }

    # only cache status ok
    if ( beresp.status != 200 ) {
        set beresp.uncacheable = true;
                set beresp.ttl = 120s;
                return (deliver);
    }

    # A TTL of 24h
    set beresp.ttl = 24h;
    # Define the default grace period to serve cached content
    set beresp.grace = 30s;

    return (deliver);
}

sub vcl_deliver {

    # Remove unnecessary headers
    unset resp.http.Server;
    unset resp.http.X-Powered-By;
    unset resp.http.X-Varnish;
    unset resp.http.Via;

    # DIAGNOSTIC HEADERS
    if (obj.hits > 0) {
        set resp.http.X-Cache = "HIT";
    } else {
        set resp.http.X-Cache = "MISS";
    }
    return (deliver);
}

sub vcl_init {
    return (ok);
}

sub vcl_fini {
    return (ok);
}

Here's my nginx conf

server {
    listen 127.0.0.1:8080;
    root /var/www/exciter;

    index index.php index.html index.htm;

    server_name exciter.com;

       location / {
                try_files $uri $uri/ /index.php?q=$uri&$args;
        }

        error_page 404 /404.html;

        location = /50x.html {
                root /usr/share/nginx/html;
        }

    location ^(.*)/uploads/pdf/(.*)/(.*).pdf(.?) {
        allow all;
    }

    # STATICS FILES
    location ~* \.(js|css|png|jpg|jpeg|gif|ico)$ {
        expires max;
        log_not_found off;
    }

        location ~ \.php$ {
                try_files $uri =404;
                fastcgi_split_path_info ^(.+\.php)(/.+)$;
                fastcgi_pass 127.0.0.1:9000;
                fastcgi_index index.php;
                fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;
                include fastcgi_params;
                #fastcgi_read_timeout 300;
        }
}

Thank you so much!

[Oyabi]

That's seem correct.
Try this : http://serverfault.com/a/616663/215569
You must login in varnish user, or other user if varnish user don't have shell, and try to wget/curl 127.0.0.1:8080.

When you restart varnish and nginx, did you get some error ?

[dofrance]

There's no error for Nginx and Varnish log. I restart services and also restart the server :D
I did Curl and the front end of website is coming. But when I try to login, there is no hit to the backend like Varnish log I posted!

[Oyabi]

Sorry but i don't know what cause that.
Maybe try to change

backend default {
    .host = "127.0.0.1";
    .port = "8888";
}

by

backend default {
    .host = "127.0.0.1";
    .port = "8080";
}

[dofrance]

It Rock now! My mistake for old default stuff
You're great!

[dofrance]

Uh, Oh
Seem like, Add to cart button of my Woocomerce not working properly. I add something to cart, but it not go to cart!

[Oyabi]

Hum maybe an upgrade of woocommerce.
Check the link respect this syntax :

if (req.url ~ "/(cart|my-account|checkout|addons|/?add-to-cart=)") {
            return (pass);
}

If it's not the case, add it. ;)
So you get something like that:

if (req.url ~ "/(cart|my-account|checkout|addons|YOUR ADD HERE|/?add-to-cart=)") {
            return (pass);
}

[dofrance]

The cart still not work after I put exciter.com into Your ADD HERE
what about if I have multiple backend

[Oyabi]

Hum, it's not really that, you can remove your add.
I do not use myself woocommerce so my knowledge are limited.
Maybe they upgrade the way to add item to cart.
Try to add that (like here http://docs.woothemes.com/document/configuring-caching-plugins/):

if ( req.url ~ "\?add-to-cart=" ) {
 return (pass);
 }

[dofrance]

Sadly, I already try, restart varnish and nginx but it still not work
Thank you for your help!

[Oyabi]

Sorry, but I have no more idea.
Maybe try to post on woocommerce forum. :(
Keep me informed. ;)

++

[ablears]

In vcl_recv, try

# Do not cache the WooCommerce pages
    if (req.url ~ "/(cart|my-account|checkout|addons|/?add-to-cart=)") {
      return (pass);
    } 

# don't cache ajax requests
if (req.http.X-Requested-With == "XMLHttpRequest") {
  return (pass);
}

if (req.http.cookie) {
  if (req.http.cookie ~ "(wordpress_|wp-settings-|wp_|woo_|woocommerce_)") {
      return(pass);
  } else {
    unset req.http.cookie;
  }
}

In vcl_backend_response I have:

if ( bereq.method == "POST" || bereq.http.Authorization ) {
  set beresp.uncacheable = true;
  set beresp.ttl = 120s;
  return (deliver);
}

if ( (!(bereq.url ~ "(wp-login|wp-admin|cart|checkout|transaction-results|my-account|product)")) ) {
  unset beresp.http.set-cookie;
  set beresp.ttl = 1h;
}

with this, Woo works fine using Varnish 4