In this talk I will describe our recent efforts within the PT-STAR project for speech translation across languages. I will begin with brief descriptions about the component systems for speech recognition, machine translation and speech synthesis and talk in greater detail about modeling and conversion of prosodic aspects of speech across languages, a major part of speaking style. Illustrating with example demos for the case of English<->Portuguese translation, I will comment on the bottlenecks in the current speech translation technology and list some challenges for the future that may be of interest to ML/Speech/NLP research community.