A fully asynchronous network with one sensor and M anchors (nodes with known locations) is considered in this letter. We propose a novel asymmetrical time-stamping and passive listening (ATPL) protocol for joint clock synchronization and ranging. The ATPL protocol exploits broadcast to not only reduce the number of active transmissions between the nodes, but also to obtain more information. This is used in a simple estimator based on least-squares (LS) to jointly estimate all the unknown clock-skews, clock-offsets, and pairwise distances of the sensor to each anchor. The Cramér-Rao lower bound (CRLB) is derived for the considered problem. The proposed estimator is shown to be asymptotically efficient, meets the CRLB, and also performs better than the available clock synchronization algorithms.