7 down vote accepted
OK, it is working, and for referencing here is how I did it, hopefully someone will find it useful.
I found the solution on the following sites:
1- Multiple interfaces on the same subnet 2- Two network interfaces and two IP addresses on the same subnet in Linux
And the website that i referenced in the question as well.
suppose I have two IP addresses: 22.214.171.124 & 126.96.36.199 on network 188.8.131.52 and they have a gateway 184.108.40.206
I enabled ARP filtering:
And the I configured /etc/network/interfaces as following:
And I added the following two lines to /etc/iproute2/rt_tables