7 down vote accepted
OK, it is working, and for referencing here is how I did it, hopefully someone will find it useful.
I found the solution on the following sites:
1- Multiple interfaces on the same subnet 2- Two network interfaces and two IP addresses on the same subnet in Linux
And the website that i referenced in the question as well.
suppose I have two IP addresses: 126.96.36.199 & 188.8.131.52 on network 184.108.40.206 and they have a gateway 220.127.116.11
I enabled ARP filtering:
And the I configured /etc/network/interfaces as following:
And I added the following two lines to /etc/iproute2/rt_tables