7 down vote accepted
OK, it is working, and for referencing here is how I did it, hopefully someone will find it useful.
I found the solution on the following sites:
1- Multiple interfaces on the same subnet 2- Two network interfaces and two IP addresses on the same subnet in Linux
And the website that i referenced in the question as well.
suppose I have two IP addresses: 220.127.116.11 & 18.104.22.168 on network 22.214.171.124 and they have a gateway 126.96.36.199
I enabled ARP filtering:
And the I configured /etc/network/interfaces as following:
And I added the following two lines to /etc/iproute2/rt_tables