7 down vote accepted
OK, it is working, and for referencing here is how I did it, hopefully someone will find it useful.
I found the solution on the following sites:
1- Multiple interfaces on the same subnet 2- Two network interfaces and two IP addresses on the same subnet in Linux
And the website that i referenced in the question as well.
suppose I have two IP addresses: 18.104.22.168 & 22.214.171.124 on network 126.96.36.199 and they have a gateway 188.8.131.52
I enabled ARP filtering:
And the I configured /etc/network/interfaces as following:
And I added the following two lines to /etc/iproute2/rt_tables