The DEAD-box protein DDX6 is a central component of translational repression mechanisms in maternal mRNA storage in oocytes and microRNA-mediated silencing in somatic cells. DDX6 interacts with the CCR4-NOT complex and functions in concert with several post-transcriptional regulators, including Edc3, Pat1, and 4E-T. We show that the conserved CUP-homology domain (CHD) of human 4E-T interacts directly with DDX6 in both the presence and absence of the central MIF4G domain of CNOT1. The 2.1-Å resolution structure of the corresponding ternary complex reveals how 4E-T CHD wraps around the RecA2 domain of DDX6 and contacts CNOT1. Although 4E-T CHD lacks recognizable sequence similarity with Edc3 or Pat1, it shares the same DDX6-binding surface. In contrast to 4E-T, however, the Edc3 and Pat1 FDF motifs dissociate from DDX6 upon CNOT1 MIF4G binding in vitro. The results underscore the presence of a complex network of simultaneous and/or mutually exclusive interactions in DDX6-mediated repression.